TsTabletManagerITest.TestTableStats: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:783: Failure
Expected equality of these values:
  live_row_count
    Which is: 802
  table_info->GetMetrics()->live_row_count->value()
    Which is: 1604
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:767: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:785: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 782, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:895: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20260620 09:20:19.882155  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
W20260620 09:20:19.911212 11670 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260620 09:20:19.917912 11670 consensus_peers.cc:487] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Couldn't send request to peer 369e0e637f7b495d954f88956390d6eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:19.919376  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:19.920326  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.921523  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:19.922171  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.924896  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.925359  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:19.925797  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.929149  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.929740  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 LEADER]: Raft consensus shutting down.
I20260620 09:20:19.930718  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.955004  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
W20260620 09:20:19.965183 11670 consensus_peers.cc:487] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Couldn't send request to peer 369e0e637f7b495d954f88956390d6eb. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.193:44211: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:19.975270  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
W20260620 09:20:20.003033 11672 consensus_peers.cc:487] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Couldn't send request to peer 89fdaefc8a1b44e4b64fc41474ee4d77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.019721  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:20.020460  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.021179  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.021766  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.024593  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.025058  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.025461  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.027881  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.028414  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.028973  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.060582  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
W20260620 09:20:20.061102 11672 consensus_peers.cc:487] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Couldn't send request to peer 89fdaefc8a1b44e4b64fc41474ee4d77. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.194:35385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.075412  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:20:20.107636 12138 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 369e0e637f7b495d954f88956390d6eb)
I20260620 09:20:20.108282 12138 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:20.110330 12138 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:20:20.112270  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:20.113301  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.114212  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.114916  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260620 09:20:20.115085 11670 leader_election.cc:334] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Network error: Client connection negotiation failed: client connection to 127.9.154.193:44211: connect: Connection refused (error 111)
W20260620 09:20:20.115862 11672 leader_election.cc:334] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Network error: Client connection negotiation failed: client connection to 127.9.154.194:35385: connect: Connection refused (error 111)
I20260620 09:20:20.116196 11672 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77
W20260620 09:20:20.116703 11672 raft_consensus.cc:2670] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 09:20:20.118644  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.119321  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.120283  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.122907  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.123364  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.124200  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.147790  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:20:20.165396  9835 master.cc:537] Master@127.9.154.254:33389 shutting down...
I20260620 09:20:20.192739  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.193344  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.193725  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:20.212769  9835 master.cc:552] Master@127.9.154.254:33389 shutdown complete.
I20260620 09:20:20.232159  9835 master.cc:537] Master@127.9.154.253:34215 shutting down...
W20260620 09:20:20.249900 11335 consensus_peers.cc:487] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 -> Peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Couldn't send request to peer c95ff81a1269446382d58a346826f385. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.257858  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.258818  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.259150  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: stopping tablet replica
I20260620 09:20:20.305516  9835 master.cc:552] Master@127.9.154.253:34215 shutdown complete.
I20260620 09:20:20.326793  9835 master.cc:537] Master@127.9.154.252:38359 shutting down...
I20260620 09:20:20.347808  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.348366  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.348676  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:20.385092  9835 master.cc:552] Master@127.9.154.252:38359 shutdown complete.
I20260620 09:20:20.411586  9835 test_util.cc:175] -----------------------------------------------
I20260620 09:20:20.411800  9835 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0

[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN      ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260620 09:19:29.880553  9835 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.264s	user 0.475s	sys 0.787s
W20260620 09:19:29.881206  9835 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.265s	user 0.475s	sys 0.787s
I20260620 09:19:29.885380  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:38139
I20260620 09:19:29.887266  9835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 09:19:29.888722  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:29.907793  9847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:29.908479  9846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:30.017792  9849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:30.017877  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:30.019177  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:30.019407  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:30.019608  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947170019590 us; error 0 us; skew 500 ppm
I20260620 09:19:30.020398  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:30.030200  9835 webserver.cc:460] Webserver started at http://127.9.154.254:39615/ using document root <none> and password file <none>
I20260620 09:19:30.031234  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:30.031468  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:30.031912  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:30.037945  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "380ccdfe64dc4a58a00a7d914b68904f"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.045503  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260620 09:19:30.050884  9854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.052250  9835 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:19:30.052620  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "380ccdfe64dc4a58a00a7d914b68904f"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.052966  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:30.066669  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:30.068143  9835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 09:19:30.068615  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:30.149475  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:38139
I20260620 09:19:30.149571  9905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:38139 every 8 connection(s)
I20260620 09:19:30.156694  9906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:30.181850  9906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: Bootstrap starting.
I20260620 09:19:30.188812  9906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:30.190598  9906 log.cc:824] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: Log is configured to *not* fsync() on all Append() calls
I20260620 09:19:30.195341  9906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: No bootstrap required, opened a new log
I20260620 09:19:30.220448  9906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER }
I20260620 09:19:30.220986  9906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:30.221170  9906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380ccdfe64dc4a58a00a7d914b68904f, State: Initialized, Role: FOLLOWER
I20260620 09:19:30.221930  9906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER }
I20260620 09:19:30.222440  9906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:19:30.222657  9906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:19:30.222918  9906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:30.226677  9906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER }
I20260620 09:19:30.227314  9906 leader_election.cc:302] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 380ccdfe64dc4a58a00a7d914b68904f; no voters: 
I20260620 09:19:30.229291  9906 leader_election.cc:288] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:19:30.229676  9909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:30.232210  9909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 1 LEADER]: Becoming Leader. State: Replica: 380ccdfe64dc4a58a00a7d914b68904f, State: Running, Role: LEADER
I20260620 09:19:30.233130  9909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER }
I20260620 09:19:30.234105  9906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:30.244719  9910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "380ccdfe64dc4a58a00a7d914b68904f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER } }
I20260620 09:19:30.245561  9910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:30.246377  9911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 380ccdfe64dc4a58a00a7d914b68904f. Latest consensus state: current_term: 1 leader_uuid: "380ccdfe64dc4a58a00a7d914b68904f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "380ccdfe64dc4a58a00a7d914b68904f" member_type: VOTER } }
I20260620 09:19:30.247117  9911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:30.250209  9918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:30.262691  9918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:30.264850  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:30.279966  9918 catalog_manager.cc:1347] Generated new cluster ID: beccf15b4225449d8c5bcfd5f42e5c14
I20260620 09:19:30.280313  9918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:30.311834  9918 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:30.313959  9918 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:30.337160  9918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: Generated new TSK 0
I20260620 09:19:30.338121  9918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:30.396461  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:30.408087  9928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:30.411320  9929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:30.413947  9931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:30.414702  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:30.415594  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:30.415863  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:30.416074  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947170416059 us; error 0 us; skew 500 ppm
I20260620 09:19:30.416827  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:30.421823  9835 webserver.cc:460] Webserver started at http://127.9.154.193:34339/ using document root <none> and password file <none>
I20260620 09:19:30.422607  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:30.422860  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:30.423204  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:30.424846  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "1d0823e3bd4042be93f2f49b8dc73509"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.432116  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260620 09:19:30.437568  9936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.438530  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 09:19:30.438863  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "1d0823e3bd4042be93f2f49b8dc73509"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.439253  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:30.472371  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:30.474004  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:30.476724  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:30.482535  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:30.482811  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.483075  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:30.483259  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.593227  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:42237
I20260620 09:19:30.593802  9998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:42237 every 8 connection(s)
I20260620 09:19:30.600538  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:30.615525 10004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:30.618351 10003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:30.634948 10006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:30.636569  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:30.637476  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:30.637718  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:30.637890  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947170637880 us; error 0 us; skew 500 ppm
I20260620 09:19:30.638573  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:30.640141  9999 heartbeater.cc:347] Connected to a master server at 127.9.154.254:38139
I20260620 09:19:30.640672  9999 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:30.641714  9999 heartbeater.cc:511] Master 127.9.154.254:38139 requested a full tablet report, sending...
I20260620 09:19:30.642794  9835 webserver.cc:460] Webserver started at http://127.9.154.194:42427/ using document root <none> and password file <none>
I20260620 09:19:30.643417  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:30.643594  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:30.643791  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:30.645152  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "2e37232015694f1181ccd45be5ef96f6"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.645207  9871 ts_manager.cc:194] Registered new tserver with Master: 1d0823e3bd4042be93f2f49b8dc73509 (127.9.154.193:42237)
I20260620 09:19:30.648341  9871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39666
I20260620 09:19:30.652431  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260620 09:19:30.657150 10011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.657960  9835 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:19:30.658267  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "2e37232015694f1181ccd45be5ef96f6"
format_stamp: "Formatted at 2026-06-20 09:19:30 on dist-test-slave-zmgx"
I20260620 09:19:30.658529  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:30.683171  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:30.684340  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:30.686841  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:30.690893  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:30.691067  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.691352  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:30.691486  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:30.753899  9999 heartbeater.cc:503] Master 127.9.154.254:38139 was elected leader, sending a full tablet report...
I20260620 09:19:30.798341  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:39927
I20260620 09:19:30.798456 10073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:39927 every 8 connection(s)
I20260620 09:19:30.819497 10074 heartbeater.cc:347] Connected to a master server at 127.9.154.254:38139
I20260620 09:19:30.819856 10074 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:30.820612 10074 heartbeater.cc:511] Master 127.9.154.254:38139 requested a full tablet report, sending...
I20260620 09:19:30.822700  9871 ts_manager.cc:194] Registered new tserver with Master: 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194:39927)
I20260620 09:19:30.823088  9835 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.019024945s
I20260620 09:19:30.824697  9871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39678
I20260620 09:19:30.862479  9871 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39690:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
  hash_schema {
    columns {
      name: "key"
    }
    num_buckets: 2
    seed: 0
  }
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 09:19:30.887466  9871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260620 09:19:30.929176 10074 heartbeater.cc:503] Master 127.9.154.254:38139 was elected leader, sending a full tablet report...
I20260620 09:19:30.963506 10039 tablet_service.cc:1467] Processing CreateTablet for tablet 69f86341fb9a4837a24909dcc3e1d850 (DEFAULT_TABLE table=test-table [id=5a6d3f2fed204083a12d8a232b141513]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:30.963881 10038 tablet_service.cc:1467] Processing CreateTablet for tablet 45eedb458cea48aead7ba59f67bc344d (DEFAULT_TABLE table=test-table [id=5a6d3f2fed204083a12d8a232b141513]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:30.963973  9964 tablet_service.cc:1467] Processing CreateTablet for tablet 69f86341fb9a4837a24909dcc3e1d850 (DEFAULT_TABLE table=test-table [id=5a6d3f2fed204083a12d8a232b141513]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:30.966363  9964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f86341fb9a4837a24909dcc3e1d850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:30.967360 10039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f86341fb9a4837a24909dcc3e1d850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:30.968986  9963 tablet_service.cc:1467] Processing CreateTablet for tablet 45eedb458cea48aead7ba59f67bc344d (DEFAULT_TABLE table=test-table [id=5a6d3f2fed204083a12d8a232b141513]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:30.970238 10038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45eedb458cea48aead7ba59f67bc344d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:30.970368  9963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45eedb458cea48aead7ba59f67bc344d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:31.000456 10090 tablet_bootstrap.cc:492] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: Bootstrap starting.
I20260620 09:19:31.001029 10091 tablet_bootstrap.cc:492] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: Bootstrap starting.
I20260620 09:19:31.007503 10090 tablet_bootstrap.cc:654] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:31.008158 10091 tablet_bootstrap.cc:654] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:31.015295 10090 tablet_bootstrap.cc:492] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: No bootstrap required, opened a new log
I20260620 09:19:31.015970 10090 ts_tablet_manager.cc:1397] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.009s
I20260620 09:19:31.016556 10091 tablet_bootstrap.cc:492] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: No bootstrap required, opened a new log
I20260620 09:19:31.016996 10091 ts_tablet_manager.cc:1397] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260620 09:19:31.019505 10091 raft_consensus.cc:348] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:31.020197 10091 raft_consensus.cc:729] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Initialized, Role: FOLLOWER
I20260620 09:19:31.019383 10090 raft_consensus.cc:348] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:31.020695 10090 raft_consensus.cc:729] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0823e3bd4042be93f2f49b8dc73509, State: Initialized, Role: FOLLOWER
I20260620 09:19:31.020776 10091 consensus_queue.cc:260] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:31.021327 10090 consensus_queue.cc:260] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:31.025960 10091 ts_tablet_manager.cc:1428] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260620 09:19:31.026856 10091 tablet_bootstrap.cc:492] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: Bootstrap starting.
I20260620 09:19:31.031795 10090 ts_tablet_manager.cc:1428] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.007s
I20260620 09:19:31.033494 10091 tablet_bootstrap.cc:654] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:31.041541 10090 tablet_bootstrap.cc:492] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: Bootstrap starting.
I20260620 09:19:31.053012 10090 tablet_bootstrap.cc:654] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: Neither blocks nor log segments found. Creating new log.
W20260620 09:19:31.054271 10075 tablet.cc:2369] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 09:19:31.064713 10091 tablet_bootstrap.cc:492] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: No bootstrap required, opened a new log
I20260620 09:19:31.065320 10091 ts_tablet_manager.cc:1397] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.021s
I20260620 09:19:31.068456 10090 tablet_bootstrap.cc:492] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: No bootstrap required, opened a new log
I20260620 09:19:31.068862 10090 ts_tablet_manager.cc:1397] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260620 09:19:31.068953 10091 raft_consensus.cc:348] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:31.069689 10091 raft_consensus.cc:729] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Initialized, Role: FOLLOWER
I20260620 09:19:31.070320 10091 consensus_queue.cc:260] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:31.072003 10090 raft_consensus.cc:348] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:31.072438 10091 ts_tablet_manager.cc:1428] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260620 09:19:31.072798 10090 raft_consensus.cc:729] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0823e3bd4042be93f2f49b8dc73509, State: Initialized, Role: FOLLOWER
I20260620 09:19:31.073484 10090 consensus_queue.cc:260] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:31.077984 10090 ts_tablet_manager.cc:1428] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260620 09:19:31.105605  9835 ts_tablet_manager-itest.cc:367] Electing peer 2...
I20260620 09:19:31.105909  9835 raft_consensus.cc:412] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Emulating election...
I20260620 09:19:31.106153  9835 raft_consensus.cc:3037] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:31.109922  9835 raft_consensus.cc:686] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:31.110692  9835 consensus_queue.cc:237] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:31.114675  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:31.123099  9871 catalog_manager.cc:5495] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194). New cstate: current_term: 1 leader_uuid: "2e37232015694f1181ccd45be5ef96f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: UNKNOWN } } }
I20260620 09:19:31.145738  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:31.250416  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:31.454330  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:31.576083  9974 raft_consensus.cc:3037] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:31.584038 10094 consensus_queue.cc:1035] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:31.759222  9835 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260620 09:19:31.759545  9835 raft_consensus.cc:412] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Emulating election...
I20260620 09:19:31.759886  9835 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:31.763916  9835 raft_consensus.cc:686] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:31.764598  9835 consensus_queue.cc:237] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:31.766810  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:31.771277  9870 catalog_manager.cc:5495] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194). New cstate: current_term: 1 leader_uuid: "2e37232015694f1181ccd45be5ef96f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:31.773046  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:31.877113  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:32.081126  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260620 09:19:32.267035  9974 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:32.272710 10104 consensus_queue.cc:1035] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:32.586265  9835 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260620 09:19:32.586555  9835 raft_consensus.cc:412] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Emulating election...
I20260620 09:19:32.586748  9835 raft_consensus.cc:3032] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:32.586896  9835 raft_consensus.cc:729] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:32.587369  9835 consensus_queue.cc:260] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:32.588095  9835 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:32.591897  9835 raft_consensus.cc:686] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 2 LEADER]: Becoming Leader. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:32.592473  9835 consensus_queue.cc:237] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:32.594604  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:32.598804  9870 catalog_manager.cc:5495] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "2e37232015694f1181ccd45be5ef96f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:32.599375  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260620 09:19:32.703200  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260620 09:19:32.907917  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260620 09:19:33.107373  9974 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:33.112182  9974 raft_consensus.cc:1261] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 FOLLOWER]: Refusing update from remote peer 2e37232015694f1181ccd45be5ef96f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 09:19:33.113441 10104 consensus_queue.cc:1035] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:19:33.212538  9835 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260620 09:19:33.212771  9835 raft_consensus.cc:412] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 FOLLOWER]: Emulating election...
I20260620 09:19:33.212952  9835 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:33.216578  9835 raft_consensus.cc:686] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 3 LEADER]: Becoming Leader. State: Replica: 1d0823e3bd4042be93f2f49b8dc73509, State: Running, Role: LEADER
I20260620 09:19:33.217216  9835 consensus_queue.cc:237] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:33.218844  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:33.223122  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260620 09:19:33.222823  9869 catalog_manager.cc:5495] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 reported cstate change: term changed from 2 to 3, leader changed from 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194) to 1d0823e3bd4042be93f2f49b8dc73509 (127.9.154.193). New cstate: current_term: 3 leader_uuid: "1d0823e3bd4042be93f2f49b8dc73509" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: UNKNOWN } } }
I20260620 09:19:33.326998  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260620 09:19:33.531606  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260620 09:19:33.651906  9974 raft_consensus.cc:1226] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 3 LEADER]: Rejecting Update request from peer 2e37232015694f1181ccd45be5ef96f6 for earlier term 2. Current term is 3. Ops: []
I20260620 09:19:33.653139 10126 consensus_queue.cc:1046] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:33.654304 10126 consensus_queue.cc:1225] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Peer 1d0823e3bd4042be93f2f49b8dc73509 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260620 09:19:33.654918 10127 raft_consensus.cc:3032] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 09:19:33.655562 10127 raft_consensus.cc:729] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:33.656355 10127 consensus_queue.cc:260] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:33.657409 10127 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:33.723393 10049 raft_consensus.cc:1261] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 3 FOLLOWER]: Refusing update from remote peer 1d0823e3bd4042be93f2f49b8dc73509: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 09:19:33.724949 10119 consensus_queue.cc:1035] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:34.035517  9835 ts_tablet_manager-itest.cc:367] Electing peer 1...
I20260620 09:19:34.035930  9835 raft_consensus.cc:412] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 1 FOLLOWER]: Emulating election...
I20260620 09:19:34.036259  9835 raft_consensus.cc:3037] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:34.040448  9835 raft_consensus.cc:686] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 LEADER]: Becoming Leader. State: Replica: 1d0823e3bd4042be93f2f49b8dc73509, State: Running, Role: LEADER
I20260620 09:19:34.041170  9835 consensus_queue.cc:237] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:34.043191  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:34.046599  9870 catalog_manager.cc:5495] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 reported cstate change: term changed from 1 to 2, leader changed from 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194) to 1d0823e3bd4042be93f2f49b8dc73509 (127.9.154.193). New cstate: current_term: 2 leader_uuid: "1d0823e3bd4042be93f2f49b8dc73509" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:34.047245  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260620 09:19:34.093859  9974 raft_consensus.cc:1226] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 LEADER]: Rejecting Update request from peer 2e37232015694f1181ccd45be5ef96f6 for earlier term 1. Current term is 2. Ops: []
I20260620 09:19:34.095265 10127 consensus_queue.cc:1046] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 09:19:34.096177 10127 consensus_queue.cc:1225] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Peer 1d0823e3bd4042be93f2f49b8dc73509 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260620 09:19:34.096567 10126 raft_consensus.cc:3032] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:34.096874 10126 raft_consensus.cc:729] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:34.097416 10126 consensus_queue.cc:260] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } } peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } }
I20260620 09:19:34.098448 10126 raft_consensus.cc:3037] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:34.151190  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260620 09:19:34.355960  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260620 09:19:34.622936 10049 raft_consensus.cc:1261] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 2 FOLLOWER]: Refusing update from remote peer 1d0823e3bd4042be93f2f49b8dc73509: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 09:19:34.624292 10130 consensus_queue.cc:1035] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:19:34.659969  9835 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260620 09:19:34.660344  9835 raft_consensus.cc:412] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 3 FOLLOWER]: Emulating election...
I20260620 09:19:34.660588  9835 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:19:34.664425  9835 raft_consensus.cc:686] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 4 LEADER]: Becoming Leader. State: Replica: 2e37232015694f1181ccd45be5ef96f6, State: Running, Role: LEADER
I20260620 09:19:34.665026  9835 consensus_queue.cc:237] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:34.666468  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:34.670457  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260620 09:19:34.670009  9869 catalog_manager.cc:5495] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 reported cstate change: term changed from 3 to 4, leader changed from 1d0823e3bd4042be93f2f49b8dc73509 (127.9.154.193) to 2e37232015694f1181ccd45be5ef96f6 (127.9.154.194). New cstate: current_term: 4 leader_uuid: "2e37232015694f1181ccd45be5ef96f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:34.713559 10049 raft_consensus.cc:1226] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 4 LEADER]: Rejecting Update request from peer 1d0823e3bd4042be93f2f49b8dc73509 for earlier term 3. Current term is 4. Ops: []
I20260620 09:19:34.714669 10130 consensus_queue.cc:1046] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:19:34.715230 10130 consensus_queue.cc:1225] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [LEADER]: Peer 2e37232015694f1181ccd45be5ef96f6 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 09:19:34.715592 10139 raft_consensus.cc:3032] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 09:19:34.715871 10139 raft_consensus.cc:729] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1d0823e3bd4042be93f2f49b8dc73509, State: Running, Role: LEADER
I20260620 09:19:34.716325 10139 consensus_queue.cc:260] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 } } peers { permanent_uuid: "2e37232015694f1181ccd45be5ef96f6" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39927 } }
I20260620 09:19:34.716981 10139 raft_consensus.cc:3037] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:19:34.774859  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260620 09:19:34.979727  9835 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260620 09:19:35.217681  9974 raft_consensus.cc:1261] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 4 FOLLOWER]: Refusing update from remote peer 2e37232015694f1181ccd45be5ef96f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 09:19:35.218899 10145 consensus_queue.cc:1035] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d0823e3bd4042be93f2f49b8dc73509" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:19:35.486712  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:19:35.509707  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:35.510371  9835 tablet_replica.cc:330] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509: stopping tablet replica
I20260620 09:19:35.511021  9835 raft_consensus.cc:2229] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 09:19:35.511433  9835 raft_consensus.cc:2258] T 45eedb458cea48aead7ba59f67bc344d P 1d0823e3bd4042be93f2f49b8dc73509 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:35.513563  9835 tablet_replica.cc:330] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509: stopping tablet replica
I20260620 09:19:35.513979  9835 raft_consensus.cc:2229] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 LEADER]: Raft consensus shutting down.
I20260620 09:19:35.514609  9835 raft_consensus.cc:2258] T 69f86341fb9a4837a24909dcc3e1d850 P 1d0823e3bd4042be93f2f49b8dc73509 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:35.604291  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:19:35.615626  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:19:35.634835  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:35.635571  9835 tablet_replica.cc:330] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6: stopping tablet replica
I20260620 09:19:35.636189  9835 raft_consensus.cc:2229] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 09:19:35.636616  9835 raft_consensus.cc:2258] T 69f86341fb9a4837a24909dcc3e1d850 P 2e37232015694f1181ccd45be5ef96f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:35.638545  9835 tablet_replica.cc:330] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6: stopping tablet replica
I20260620 09:19:35.639061  9835 raft_consensus.cc:2229] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 4 LEADER]: Raft consensus shutting down.
I20260620 09:19:35.639686  9835 raft_consensus.cc:2258] T 45eedb458cea48aead7ba59f67bc344d P 2e37232015694f1181ccd45be5ef96f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:35.649873  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:19:35.659250  9835 master.cc:537] Master@127.9.154.254:38139 shutting down...
I20260620 09:19:35.809070  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:35.809623  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:35.809949  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 380ccdfe64dc4a58a00a7d914b68904f: stopping tablet replica
I20260620 09:19:35.828279  9835 master.cc:552] Master@127.9.154.254:38139 shutdown complete.
[       OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (7266 ms)
[ RUN      ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260620 09:19:35.856127  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:42035
I20260620 09:19:35.857110  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:35.861917 10154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:35.863094 10155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:35.866115 10157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:35.866837  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:35.867642  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:35.867937  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:35.868135  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947175868119 us; error 0 us; skew 500 ppm
I20260620 09:19:35.868849  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:35.874979  9835 webserver.cc:460] Webserver started at http://127.9.154.254:40853/ using document root <none> and password file <none>
I20260620 09:19:35.875420  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:35.875577  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:35.875769  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:35.876708  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "2a9bcae905564aa5aa284c425d6d237a"
format_stamp: "Formatted at 2026-06-20 09:19:35 on dist-test-slave-zmgx"
I20260620 09:19:35.880932  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260620 09:19:35.884064 10162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:35.884807  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260620 09:19:35.885128  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "2a9bcae905564aa5aa284c425d6d237a"
format_stamp: "Formatted at 2026-06-20 09:19:35 on dist-test-slave-zmgx"
I20260620 09:19:35.885380  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:35.894842  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:35.895797  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:35.931326  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:42035
I20260620 09:19:35.931383 10213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:42035 every 8 connection(s)
I20260620 09:19:35.935101 10214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:35.943455 10214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a: Bootstrap starting.
I20260620 09:19:35.947283 10214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:35.951289 10214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a: No bootstrap required, opened a new log
I20260620 09:19:35.953503 10214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER }
I20260620 09:19:35.953939 10214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:35.954201 10214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a9bcae905564aa5aa284c425d6d237a, State: Initialized, Role: FOLLOWER
I20260620 09:19:35.954727 10214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER }
I20260620 09:19:35.955124 10214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:19:35.955358 10214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:19:35.955626 10214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:35.959347 10214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER }
I20260620 09:19:35.959904 10214 leader_election.cc:302] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a9bcae905564aa5aa284c425d6d237a; no voters: 
I20260620 09:19:35.961076 10214 leader_election.cc:288] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:19:35.961491 10217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:35.962846 10217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 1 LEADER]: Becoming Leader. State: Replica: 2a9bcae905564aa5aa284c425d6d237a, State: Running, Role: LEADER
I20260620 09:19:35.963423 10217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER }
I20260620 09:19:35.964046 10214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:35.965883 10218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a9bcae905564aa5aa284c425d6d237a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER } }
I20260620 09:19:35.965986 10219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a9bcae905564aa5aa284c425d6d237a. Latest consensus state: current_term: 1 leader_uuid: "2a9bcae905564aa5aa284c425d6d237a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a9bcae905564aa5aa284c425d6d237a" member_type: VOTER } }
I20260620 09:19:35.966454 10218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:35.966634 10219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:35.969331 10222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:35.973804 10222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:35.978511  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:35.981555 10222 catalog_manager.cc:1347] Generated new cluster ID: faf7b606dc57454da4622ed97f47e7fc
I20260620 09:19:35.981858 10222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:36.011426 10222 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:36.012956 10222 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:36.029078 10222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a: Generated new TSK 0
I20260620 09:19:36.029879 10222 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:36.044822  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:36.050683 10235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.051906 10236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.054101  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:36.054586 10238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.055483  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:36.055723  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:36.055907  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947176055888 us; error 0 us; skew 500 ppm
I20260620 09:19:36.056430  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:36.058867  9835 webserver.cc:460] Webserver started at http://127.9.154.193:34815/ using document root <none> and password file <none>
I20260620 09:19:36.059369  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:36.059582  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:36.059855  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:36.060935  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "f8bc23d603f64975bedb34a3c29075c3"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.065470  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:19:36.069042 10243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.069887  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260620 09:19:36.070207  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "f8bc23d603f64975bedb34a3c29075c3"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.070567  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:36.082036  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:36.083148  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:36.084553  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:36.086956  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:36.087191  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.087447  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:36.087628  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.126413  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:36353
I20260620 09:19:36.126533 10305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:36353 every 8 connection(s)
I20260620 09:19:36.130803  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:36.137526 10310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.138024 10311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.140874 10313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.143041  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:36.143906  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:36.144137  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:36.144316  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947176144303 us; error 0 us; skew 500 ppm
I20260620 09:19:36.144862  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:36.147158 10306 heartbeater.cc:347] Connected to a master server at 127.9.154.254:42035
I20260620 09:19:36.147526 10306 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:36.147997  9835 webserver.cc:460] Webserver started at http://127.9.154.194:45927/ using document root <none> and password file <none>
I20260620 09:19:36.148257 10306 heartbeater.cc:511] Master 127.9.154.254:42035 requested a full tablet report, sending...
I20260620 09:19:36.148490  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:36.148805  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:36.149170  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:36.150522 10179 ts_manager.cc:194] Registered new tserver with Master: f8bc23d603f64975bedb34a3c29075c3 (127.9.154.193:36353)
I20260620 09:19:36.150537  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "7c06fc3e5e2542408775c8241a7789c9"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.152489 10179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57282
I20260620 09:19:36.155972  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260620 09:19:36.159231 10318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.160214  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260620 09:19:36.160545  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "7c06fc3e5e2542408775c8241a7789c9"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.160835  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:36.211766  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:36.213114  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:36.214773  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:36.216991  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:36.217177  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.217470  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:36.217625  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.255919 10306 heartbeater.cc:503] Master 127.9.154.254:42035 was elected leader, sending a full tablet report...
I20260620 09:19:36.258734  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:34193
I20260620 09:19:36.258917 10380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:34193 every 8 connection(s)
I20260620 09:19:36.275261 10381 heartbeater.cc:347] Connected to a master server at 127.9.154.254:42035
I20260620 09:19:36.275648 10381 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:36.276268 10381 heartbeater.cc:511] Master 127.9.154.254:42035 requested a full tablet report, sending...
I20260620 09:19:36.278000 10179 ts_manager.cc:194] Registered new tserver with Master: 7c06fc3e5e2542408775c8241a7789c9 (127.9.154.194:34193)
I20260620 09:19:36.278693  9835 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.016698402s
I20260620 09:19:36.279670 10179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44552
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:421: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260620 09:19:36.304292  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:19:36.322708  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:36.338161  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:19:36.344455  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:19:36.359205  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:36.374396  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:19:36.381772  9835 master.cc:537] Master@127.9.154.254:42035 shutting down...
I20260620 09:19:36.397302  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:36.397814  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:36.398298  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2a9bcae905564aa5aa284c425d6d237a: stopping tablet replica
I20260620 09:19:36.417744  9835 master.cc:552] Master@127.9.154.254:42035 shutdown complete.
[  SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (582 ms)
[ RUN      ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260620 09:19:36.438462  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:39389
I20260620 09:19:36.439381  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:36.444927 10395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.444038 10394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.446465 10397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.447569  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:36.448305  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:36.448482  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:36.448668  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947176448655 us; error 0 us; skew 500 ppm
I20260620 09:19:36.449209  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:36.452241  9835 webserver.cc:460] Webserver started at http://127.9.154.254:36761/ using document root <none> and password file <none>
I20260620 09:19:36.452766  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:36.452972  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:36.453264  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:36.454421  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "278474d8c09d431e89450148448c8334"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.459227  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260620 09:19:36.462365 10402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.463229  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 09:19:36.463512  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "278474d8c09d431e89450148448c8334"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.463791  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:36.475730  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:36.476745  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:36.510949  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:39389
I20260620 09:19:36.511073 10453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:39389 every 8 connection(s)
I20260620 09:19:36.514825 10454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:36.523505 10454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334: Bootstrap starting.
I20260620 09:19:36.527096 10454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:36.531045 10454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334: No bootstrap required, opened a new log
I20260620 09:19:36.532838 10454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER }
I20260620 09:19:36.533249 10454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:36.533481 10454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 278474d8c09d431e89450148448c8334, State: Initialized, Role: FOLLOWER
I20260620 09:19:36.534104 10454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER }
I20260620 09:19:36.534667 10454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:19:36.534991 10454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:19:36.535295 10454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:36.539430 10454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER }
I20260620 09:19:36.540205 10454 leader_election.cc:302] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 278474d8c09d431e89450148448c8334; no voters: 
I20260620 09:19:36.541749 10454 leader_election.cc:288] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:19:36.541987 10457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:36.543639 10457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 1 LEADER]: Becoming Leader. State: Replica: 278474d8c09d431e89450148448c8334, State: Running, Role: LEADER
I20260620 09:19:36.544368 10457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER }
I20260620 09:19:36.545378 10454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:36.547140 10458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "278474d8c09d431e89450148448c8334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER } }
I20260620 09:19:36.547138 10459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 278474d8c09d431e89450148448c8334. Latest consensus state: current_term: 1 leader_uuid: "278474d8c09d431e89450148448c8334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278474d8c09d431e89450148448c8334" member_type: VOTER } }
I20260620 09:19:36.547735 10458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:36.547869 10459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:36.551048 10462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:36.559273 10462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:36.560246  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:36.567970 10462 catalog_manager.cc:1347] Generated new cluster ID: 24ea66705c184ae6aa6cdcea2ebe5053
I20260620 09:19:36.568256 10462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:36.588178 10462 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:36.589699 10462 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:36.606328 10462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334: Generated new TSK 0
I20260620 09:19:36.606945 10462 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:36.626451  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:36.632383 10475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.633742 10476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.635236  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:36.635695 10478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.636521  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:36.636754  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:36.636942  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947176636916 us; error 0 us; skew 500 ppm
I20260620 09:19:36.637463  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:36.639974  9835 webserver.cc:460] Webserver started at http://127.9.154.193:35649/ using document root <none> and password file <none>
I20260620 09:19:36.640484  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:36.640702  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:36.640977  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:36.642063  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "b32836fdc14d4cd2b19bc0914df5160b"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.647054  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260620 09:19:36.650370 10483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.651131  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:19:36.651420  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "b32836fdc14d4cd2b19bc0914df5160b"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.651713  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:36.671401  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:36.672479  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:36.673866  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:36.676087  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:36.676311  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.676574  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:36.676748  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.716410  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:36139
I20260620 09:19:36.716513 10545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:36139 every 8 connection(s)
I20260620 09:19:36.720973  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:36.727248 10550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.727466 10551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:36.732455 10553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:36.733065  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:36.733932  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:36.734175  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:36.734388  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947176734373 us; error 0 us; skew 500 ppm
I20260620 09:19:36.734908 10546 heartbeater.cc:347] Connected to a master server at 127.9.154.254:39389
I20260620 09:19:36.735035  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:36.735282 10546 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:36.736074 10546 heartbeater.cc:511] Master 127.9.154.254:39389 requested a full tablet report, sending...
I20260620 09:19:36.737715  9835 webserver.cc:460] Webserver started at http://127.9.154.194:33813/ using document root <none> and password file <none>
I20260620 09:19:36.738341  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:36.738355 10419 ts_manager.cc:194] Registered new tserver with Master: b32836fdc14d4cd2b19bc0914df5160b (127.9.154.193:36139)
I20260620 09:19:36.738668  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:36.738994  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:36.740342  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "038176a9ad274eef80479008fb70c739"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.740931 10419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50518
I20260620 09:19:36.744925  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:19:36.748283 10558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.749162  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:19:36.749416  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "038176a9ad274eef80479008fb70c739"
format_stamp: "Formatted at 2026-06-20 09:19:36 on dist-test-slave-zmgx"
I20260620 09:19:36.749677  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:36.768215  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:36.769140  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:36.770560  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:36.772790  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:36.773016  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.773275  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:36.773451  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:36.811936  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:45539
I20260620 09:19:36.812031 10620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:45539 every 8 connection(s)
I20260620 09:19:36.826263 10621 heartbeater.cc:347] Connected to a master server at 127.9.154.254:39389
I20260620 09:19:36.826648 10621 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:36.827345 10621 heartbeater.cc:511] Master 127.9.154.254:39389 requested a full tablet report, sending...
I20260620 09:19:36.829048 10419 ts_manager.cc:194] Registered new tserver with Master: 038176a9ad274eef80479008fb70c739 (127.9.154.194:45539)
I20260620 09:19:36.829226  9835 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.014393566s
I20260620 09:19:36.831292 10419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50528
I20260620 09:19:36.843838 10546 heartbeater.cc:503] Master 127.9.154.254:39389 was elected leader, sending a full tablet report...
I20260620 09:19:36.854243 10419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50534:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 09:19:36.855700 10419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260620 09:19:36.891182 10511 tablet_service.cc:1467] Processing CreateTablet for tablet 012883bd6d1b405bb9cd10ac7c89a332 (DEFAULT_TABLE table=test-table [id=0a1540e5da374a478f7350f3aba72793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:36.892462 10511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012883bd6d1b405bb9cd10ac7c89a332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:36.893538 10586 tablet_service.cc:1467] Processing CreateTablet for tablet 012883bd6d1b405bb9cd10ac7c89a332 (DEFAULT_TABLE table=test-table [id=0a1540e5da374a478f7350f3aba72793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:36.894790 10586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012883bd6d1b405bb9cd10ac7c89a332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:36.908880 10634 tablet_bootstrap.cc:492] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: Bootstrap starting.
I20260620 09:19:36.910753 10635 tablet_bootstrap.cc:492] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: Bootstrap starting.
I20260620 09:19:36.915603 10634 tablet_bootstrap.cc:654] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:36.916815 10635 tablet_bootstrap.cc:654] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:36.920670 10634 tablet_bootstrap.cc:492] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: No bootstrap required, opened a new log
I20260620 09:19:36.921101 10634 ts_tablet_manager.cc:1397] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260620 09:19:36.921579 10635 tablet_bootstrap.cc:492] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: No bootstrap required, opened a new log
I20260620 09:19:36.922000 10635 ts_tablet_manager.cc:1397] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260620 09:19:36.923558 10634 raft_consensus.cc:348] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:36.924257 10634 raft_consensus.cc:729] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Initialized, Role: FOLLOWER
I20260620 09:19:36.924335 10635 raft_consensus.cc:348] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:36.925052 10635 raft_consensus.cc:729] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038176a9ad274eef80479008fb70c739, State: Initialized, Role: FOLLOWER
I20260620 09:19:36.924914 10634 consensus_queue.cc:260] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:36.925659 10635 consensus_queue.cc:260] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:36.927994 10634 ts_tablet_manager.cc:1428] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260620 09:19:36.929358 10635 ts_tablet_manager.cc:1428] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 09:19:36.929373 10621 heartbeater.cc:503] Master 127.9.154.254:39389 was elected leader, sending a full tablet report...
I20260620 09:19:36.961973  9835 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260620 09:19:36.962235  9835 raft_consensus.cc:412] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 0 FOLLOWER]: Emulating election...
I20260620 09:19:36.962497  9835 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:36.966356  9835 raft_consensus.cc:686] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 1 LEADER]: Becoming Leader. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Running, Role: LEADER
W20260620 09:19:36.966697 10546 heartbeater.cc:644] Failed to heartbeat to 127.9.154.254:39389 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260620 09:19:36.967044  9835 consensus_queue.cc:237] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:36.968950  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:36.990114  9835 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260620 09:19:37.094197  9835 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260620 09:19:37.298458  9835 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260620 09:19:37.401007 10596 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:37.406405 10638 consensus_queue.cc:1035] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Connected to new peer: Peer: permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:37.604022  9835 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260620 09:19:37.604288  9835 raft_consensus.cc:412] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 1 LEADER]: Emulating election...
I20260620 09:19:37.604502  9835 raft_consensus.cc:3032] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:37.604700  9835 raft_consensus.cc:729] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Running, Role: LEADER
I20260620 09:19:37.605144  9835 consensus_queue.cc:260] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:37.605772  9835 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:37.609445  9835 raft_consensus.cc:686] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 2 LEADER]: Becoming Leader. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Running, Role: LEADER
I20260620 09:19:37.609923  9835 consensus_queue.cc:237] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:37.611238  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:37.615201  9835 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260620 09:19:37.718978  9835 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260620 09:19:37.922869  9835 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260620 09:19:38.065856 10596 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:38.070456 10596 raft_consensus.cc:1261] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 2 FOLLOWER]: Refusing update from remote peer b32836fdc14d4cd2b19bc0914df5160b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 09:19:38.071727 10644 consensus_queue.cc:1035] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Connected to new peer: Peer: permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:19:38.227700  9835 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260620 09:19:38.228004  9835 raft_consensus.cc:412] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 2 LEADER]: Emulating election...
I20260620 09:19:38.228269  9835 raft_consensus.cc:3032] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 2 LEADER]: Stepping down as leader of term 2
I20260620 09:19:38.228483  9835 raft_consensus.cc:729] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Running, Role: LEADER
I20260620 09:19:38.228943  9835 consensus_queue.cc:260] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:38.229625  9835 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:38.233880  9835 raft_consensus.cc:686] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 3 LEADER]: Becoming Leader. State: Replica: b32836fdc14d4cd2b19bc0914df5160b, State: Running, Role: LEADER
I20260620 09:19:38.234436  9835 consensus_queue.cc:237] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32836fdc14d4cd2b19bc0914df5160b" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 36139 } } peers { permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 } }
I20260620 09:19:38.235822  9835 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260620 09:19:38.239261  9835 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260620 09:19:38.343019  9835 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260620 09:19:38.547168  9835 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260620 09:19:38.653254 10596 raft_consensus.cc:3037] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:38.659145 10596 raft_consensus.cc:1261] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 3 FOLLOWER]: Refusing update from remote peer b32836fdc14d4cd2b19bc0914df5160b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 09:19:38.660512 10648 consensus_queue.cc:1035] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [LEADER]: Connected to new peer: Peer: permanent_uuid: "038176a9ad274eef80479008fb70c739" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 09:19:38.857698  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:19:38.884913  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:38.885664  9835 tablet_replica.cc:330] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b: stopping tablet replica
I20260620 09:19:38.886278  9835 raft_consensus.cc:2229] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 3 LEADER]: Raft consensus shutting down.
I20260620 09:19:38.886919  9835 raft_consensus.cc:2258] T 012883bd6d1b405bb9cd10ac7c89a332 P b32836fdc14d4cd2b19bc0914df5160b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:38.906324  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:19:38.915072  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:19:38.932929  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:38.933492  9835 tablet_replica.cc:330] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739: stopping tablet replica
I20260620 09:19:38.933899  9835 raft_consensus.cc:2229] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:19:38.934309  9835 raft_consensus.cc:2258] T 012883bd6d1b405bb9cd10ac7c89a332 P 038176a9ad274eef80479008fb70c739 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:38.953586  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:19:38.961783  9835 master.cc:537] Master@127.9.154.254:39389 shutting down...
I20260620 09:19:38.978153  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:38.979025  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:38.979312  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 278474d8c09d431e89450148448c8334: stopping tablet replica
I20260620 09:19:38.996364  9835 master.cc:552] Master@127.9.154.254:39389 shutdown complete.
[       OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2587 ms)
[----------] 3 tests from LeadershipChangeReportingTest (10437 ms total)

[----------] 4 tests from TsTabletManagerITest
[ RUN      ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260620 09:19:39.026417  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:43795
I20260620 09:19:39.027415  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:39.032653 10660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.033774 10661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.034711 10663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:39.036235  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:39.036918  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:39.037170  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:39.037334  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947179037322 us; error 0 us; skew 500 ppm
I20260620 09:19:39.037833  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:39.040300  9835 webserver.cc:460] Webserver started at http://127.9.154.254:44065/ using document root <none> and password file <none>
I20260620 09:19:39.040772  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:39.040964  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:39.041263  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:39.042548  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "03d4cba2c52745ec956dd0b5a7569c3b"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.046747  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260620 09:19:39.049737 10668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.050578  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:19:39.050815  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "03d4cba2c52745ec956dd0b5a7569c3b"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.051070  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:39.078379  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:39.079500  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:39.116521  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:43795
I20260620 09:19:39.116618 10719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:43795 every 8 connection(s)
I20260620 09:19:39.120405 10720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:39.129554 10720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b: Bootstrap starting.
I20260620 09:19:39.133713 10720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:39.137583 10720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b: No bootstrap required, opened a new log
I20260620 09:19:39.139465 10720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER }
I20260620 09:19:39.139853 10720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:39.140101 10720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d4cba2c52745ec956dd0b5a7569c3b, State: Initialized, Role: FOLLOWER
I20260620 09:19:39.140658 10720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER }
I20260620 09:19:39.141085 10720 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:19:39.141301 10720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:19:39.141587 10720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:39.145401 10720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER }
I20260620 09:19:39.145893 10720 leader_election.cc:302] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03d4cba2c52745ec956dd0b5a7569c3b; no voters: 
I20260620 09:19:39.147001 10720 leader_election.cc:288] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:19:39.147435 10723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:39.148757 10723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 1 LEADER]: Becoming Leader. State: Replica: 03d4cba2c52745ec956dd0b5a7569c3b, State: Running, Role: LEADER
I20260620 09:19:39.149361 10723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER }
I20260620 09:19:39.150059 10720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:39.152921 10724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER } }
I20260620 09:19:39.153002 10725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d4cba2c52745ec956dd0b5a7569c3b. Latest consensus state: current_term: 1 leader_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d4cba2c52745ec956dd0b5a7569c3b" member_type: VOTER } }
I20260620 09:19:39.153930 10725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:39.153899 10724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:39.156356 10729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:39.161764 10729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:39.164953  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:39.171079 10729 catalog_manager.cc:1347] Generated new cluster ID: de8af288dafb45ca8c582bd8da171fb8
I20260620 09:19:39.171340 10729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:39.191702 10729 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:39.193326 10729 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:39.208560 10729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b: Generated new TSK 0
I20260620 09:19:39.209221 10729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:39.231933  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:39.237710 10741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.238670 10742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.240262 10744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:39.241451  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:39.242326  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:39.242547  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:39.242678  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947179242668 us; error 0 us; skew 500 ppm
I20260620 09:19:39.243155  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:39.245774  9835 webserver.cc:460] Webserver started at http://127.9.154.193:41445/ using document root <none> and password file <none>
I20260620 09:19:39.246284  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:39.246464  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:39.246693  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:39.247795  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "80e34afeeeed40738e630aeafe0b863a"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.253077  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260620 09:19:39.256193 10749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.256891  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:19:39.257161  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "80e34afeeeed40738e630aeafe0b863a"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.257402  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:39.271200  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:39.272217  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:39.273435  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:39.275592  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:39.275760  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.276033  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:39.276217  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.315057  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:46255
I20260620 09:19:39.315145 10811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:46255 every 8 connection(s)
I20260620 09:19:39.319198  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:39.326644 10816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.327661 10817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:39.329751  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:39.330001 10819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:39.331058  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:39.331318  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:39.331530  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947179331497 us; error 0 us; skew 500 ppm
I20260620 09:19:39.332213  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:39.334429 10812 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43795
I20260620 09:19:39.334877 10812 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:39.334894  9835 webserver.cc:460] Webserver started at http://127.9.154.194:33843/ using document root <none> and password file <none>
I20260620 09:19:39.335513  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:39.335721  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:39.335686 10812 heartbeater.cc:511] Master 127.9.154.254:43795 requested a full tablet report, sending...
I20260620 09:19:39.336272  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:39.337878  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "c767802094ef44d08661ab90c574255c"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.338307 10685 ts_manager.cc:194] Registered new tserver with Master: 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255)
I20260620 09:19:39.340410 10685 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52252
I20260620 09:19:39.343744  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260620 09:19:39.346886 10824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.347597  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:19:39.347894  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "c767802094ef44d08661ab90c574255c"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.348179  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:39.363049  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:39.364476  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:39.365949  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:39.368278  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:39.368506  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.368767  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:39.368947  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.410490  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:39969
I20260620 09:19:39.410610 10886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:39969 every 8 connection(s)
I20260620 09:19:39.415107  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:39.421921 10890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.423962 10891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:39.426550 10893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:39.426793  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:39.427793  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:39.428035  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:39.428292  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947179428267 us; error 0 us; skew 500 ppm
I20260620 09:19:39.428930  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:39.430320 10887 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43795
I20260620 09:19:39.430733 10887 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:39.431355 10887 heartbeater.cc:511] Master 127.9.154.254:43795 requested a full tablet report, sending...
I20260620 09:19:39.432096  9835 webserver.cc:460] Webserver started at http://127.9.154.195:43899/ using document root <none> and password file <none>
I20260620 09:19:39.432672  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:39.432896  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:39.433188  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:39.433310 10685 ts_manager.cc:194] Registered new tserver with Master: c767802094ef44d08661ab90c574255c (127.9.154.194:39969)
I20260620 09:19:39.434530  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-2-root/instance:
uuid: "16e8f796ce4b4967af930d9ab1d6bfd3"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.434935 10685 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52254
I20260620 09:19:39.439246  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:19:39.442655 10898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.443411  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 09:19:39.443710  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-2-root
uuid: "16e8f796ce4b4967af930d9ab1d6bfd3"
format_stamp: "Formatted at 2026-06-20 09:19:39 on dist-test-slave-zmgx"
I20260620 09:19:39.444001  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1781947168426282-9835-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:39.460783  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:39.462071  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:39.463621  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:39.466301  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:39.466565  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.466840  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:39.467032  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:39.536933  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.195:44627
I20260620 09:19:39.537026 10960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.195:44627 every 8 connection(s)
I20260620 09:19:39.556032 10961 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43795
I20260620 09:19:39.556411 10961 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:39.557044 10961 heartbeater.cc:511] Master 127.9.154.254:43795 requested a full tablet report, sending...
I20260620 09:19:39.559365 10685 ts_manager.cc:194] Registered new tserver with Master: 16e8f796ce4b4967af930d9ab1d6bfd3 (127.9.154.195:44627)
I20260620 09:19:39.559543  9835 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017843008s
I20260620 09:19:39.561088 10685 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52264
I20260620 09:19:39.587401 10685 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52278:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
  }
}
W20260620 09:19:39.588968 10685 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 09:19:39.638010 10926 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7919c4ccad419a93e82eec1a8961e3 (DEFAULT_TABLE table=test-table [id=e7fe7ec041fe4744b7ec16bc2913fd02]), partition=
I20260620 09:19:39.639420 10926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7919c4ccad419a93e82eec1a8961e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:39.641783 10777 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7919c4ccad419a93e82eec1a8961e3 (DEFAULT_TABLE table=test-table [id=e7fe7ec041fe4744b7ec16bc2913fd02]), partition=
I20260620 09:19:39.642752 10777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7919c4ccad419a93e82eec1a8961e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:39.645582 10852 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7919c4ccad419a93e82eec1a8961e3 (DEFAULT_TABLE table=test-table [id=e7fe7ec041fe4744b7ec16bc2913fd02]), partition=
I20260620 09:19:39.646608 10852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7919c4ccad419a93e82eec1a8961e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:39.655483 10976 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: Bootstrap starting.
I20260620 09:19:39.657812 10977 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: Bootstrap starting.
I20260620 09:19:39.661691 10976 tablet_bootstrap.cc:654] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:39.666144 10977 tablet_bootstrap.cc:654] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:39.666922 10978 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: Bootstrap starting.
I20260620 09:19:39.671878 10978 tablet_bootstrap.cc:654] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:39.672250 10976 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: No bootstrap required, opened a new log
I20260620 09:19:39.672684 10976 ts_tablet_manager.cc:1397] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260620 09:19:39.671870 10977 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: No bootstrap required, opened a new log
I20260620 09:19:39.675441 10976 raft_consensus.cc:348] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.676054 10976 raft_consensus.cc:374] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:39.676163 10977 ts_tablet_manager.cc:1397] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
I20260620 09:19:39.676359 10976 raft_consensus.cc:729] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80e34afeeeed40738e630aeafe0b863a, State: Initialized, Role: FOLLOWER
I20260620 09:19:39.677119 10976 consensus_queue.cc:260] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.678093 10977 raft_consensus.cc:348] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.678989 10977 raft_consensus.cc:374] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:39.679343 10977 raft_consensus.cc:729] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16e8f796ce4b4967af930d9ab1d6bfd3, State: Initialized, Role: FOLLOWER
I20260620 09:19:39.680002 10812 heartbeater.cc:503] Master 127.9.154.254:43795 was elected leader, sending a full tablet report...
I20260620 09:19:39.680414 10978 tablet_bootstrap.cc:492] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: No bootstrap required, opened a new log
I20260620 09:19:39.680563 10976 ts_tablet_manager.cc:1428] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260620 09:19:39.680222 10977 consensus_queue.cc:260] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.680819 10978 ts_tablet_manager.cc:1397] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.003s
I20260620 09:19:39.683560 10961 heartbeater.cc:503] Master 127.9.154.254:43795 was elected leader, sending a full tablet report...
I20260620 09:19:39.683314 10978 raft_consensus.cc:348] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.684053 10977 ts_tablet_manager.cc:1428] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260620 09:19:39.684046 10978 raft_consensus.cc:374] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:39.684538 10978 raft_consensus.cc:729] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c767802094ef44d08661ab90c574255c, State: Initialized, Role: FOLLOWER
I20260620 09:19:39.685199 10978 consensus_queue.cc:260] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.688763 10887 heartbeater.cc:503] Master 127.9.154.254:43795 was elected leader, sending a full tablet report...
I20260620 09:19:39.689270 10978 ts_tablet_manager.cc:1428] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260620 09:19:39.835218 10982 raft_consensus.cc:482] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:39.835630 10982 raft_consensus.cc:504] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.837564 10982 leader_election.cc:288] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16e8f796ce4b4967af930d9ab1d6bfd3 (127.9.154.195:44627), c767802094ef44d08661ab90c574255c (127.9.154.194:39969)
I20260620 09:19:39.853871 10936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "80e34afeeeed40738e630aeafe0b863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" is_pre_election: true
I20260620 09:19:39.853734 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "80e34afeeeed40738e630aeafe0b863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c767802094ef44d08661ab90c574255c" is_pre_election: true
I20260620 09:19:39.854666 10936 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80e34afeeeed40738e630aeafe0b863a in term 0.
I20260620 09:19:39.854667 10862 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80e34afeeeed40738e630aeafe0b863a in term 0.
I20260620 09:19:39.855909 10752 leader_election.cc:302] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16e8f796ce4b4967af930d9ab1d6bfd3, 80e34afeeeed40738e630aeafe0b863a; no voters: 
I20260620 09:19:39.856609 10982 raft_consensus.cc:2781] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:19:39.856921 10982 raft_consensus.cc:482] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:39.857204 10982 raft_consensus.cc:3037] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:39.862663 10982 raft_consensus.cc:504] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.864151 10982 leader_election.cc:288] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [CANDIDATE]: Term 1 election: Requested vote from peers 16e8f796ce4b4967af930d9ab1d6bfd3 (127.9.154.195:44627), c767802094ef44d08661ab90c574255c (127.9.154.194:39969)
I20260620 09:19:39.865028 10936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "80e34afeeeed40738e630aeafe0b863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3"
I20260620 09:19:39.865147 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "80e34afeeeed40738e630aeafe0b863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c767802094ef44d08661ab90c574255c"
I20260620 09:19:39.865496 10936 raft_consensus.cc:3037] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:39.865679 10862 raft_consensus.cc:3037] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:39.870065 10862 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80e34afeeeed40738e630aeafe0b863a in term 1.
I20260620 09:19:39.870151 10936 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80e34afeeeed40738e630aeafe0b863a in term 1.
I20260620 09:19:39.871060 10752 leader_election.cc:302] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80e34afeeeed40738e630aeafe0b863a, c767802094ef44d08661ab90c574255c; no voters: 
I20260620 09:19:39.871691 10982 raft_consensus.cc:2781] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:39.872640 10982 raft_consensus.cc:686] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 1 LEADER]: Becoming Leader. State: Replica: 80e34afeeeed40738e630aeafe0b863a, State: Running, Role: LEADER
I20260620 09:19:39.873430 10982 consensus_queue.cc:237] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:39.879652 10684 catalog_manager.cc:5495] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a reported cstate change: term changed from 0 to 1, leader changed from <none> to 80e34afeeeed40738e630aeafe0b863a (127.9.154.193). New cstate: current_term: 1 leader_uuid: "80e34afeeeed40738e630aeafe0b863a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } health_report { overall_health: UNKNOWN } } }
I20260620 09:19:40.269292 10982 consensus_queue.cc:1035] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [LEADER]: Connected to new peer: Peer: permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:40.280021 10987 consensus_queue.cc:1035] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:40.990038  9835 tablet_replica.cc:330] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a: stopping tablet replica
I20260620 09:19:40.990629  9835 raft_consensus.cc:2229] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:40.991317  9835 raft_consensus.cc:2258] T 4c7919c4ccad419a93e82eec1a8961e3 P 80e34afeeeed40738e630aeafe0b863a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:42.183277 10998 raft_consensus.cc:482] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80e34afeeeed40738e630aeafe0b863a)
I20260620 09:19:42.183777 10998 raft_consensus.cc:504] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:42.185685 10998 leader_election.cc:288] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255), c767802094ef44d08661ab90c574255c (127.9.154.194:39969)
I20260620 09:19:42.202205 11003 raft_consensus.cc:482] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80e34afeeeed40738e630aeafe0b863a)
I20260620 09:19:42.202790 11003 raft_consensus.cc:504] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:42.205399 11003 leader_election.cc:288] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16e8f796ce4b4967af930d9ab1d6bfd3 (127.9.154.195:44627), 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255)
I20260620 09:19:42.220074 10787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80e34afeeeed40738e630aeafe0b863a" is_pre_election: true
W20260620 09:19:42.222023 10900 leader_election.cc:341] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255): Illegal state: cannot vote while shut down
I20260620 09:19:42.225832 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c767802094ef44d08661ab90c574255c" is_pre_election: true
I20260620 09:19:42.226570 10862 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16e8f796ce4b4967af930d9ab1d6bfd3 in term 1.
I20260620 09:19:42.227697 10901 leader_election.cc:302] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16e8f796ce4b4967af930d9ab1d6bfd3, c767802094ef44d08661ab90c574255c; no voters: 80e34afeeeed40738e630aeafe0b863a
I20260620 09:19:42.228641 10998 raft_consensus.cc:2781] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:42.228997 10998 raft_consensus.cc:482] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80e34afeeeed40738e630aeafe0b863a)
I20260620 09:19:42.229337 10998 raft_consensus.cc:3037] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:42.236155 10998 raft_consensus.cc:504] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:42.237432 10936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "c767802094ef44d08661ab90c574255c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" is_pre_election: true
I20260620 09:19:42.238302 10936 raft_consensus.cc:2379] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c767802094ef44d08661ab90c574255c in current term 2: Already voted for candidate 16e8f796ce4b4967af930d9ab1d6bfd3 in this term.
I20260620 09:19:42.238586 10998 leader_election.cc:288] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 election: Requested vote from peers 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255), c767802094ef44d08661ab90c574255c (127.9.154.194:39969)
I20260620 09:19:42.237421 10787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "c767802094ef44d08661ab90c574255c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80e34afeeeed40738e630aeafe0b863a" is_pre_election: true
I20260620 09:19:42.239481 10786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80e34afeeeed40738e630aeafe0b863a"
I20260620 09:19:42.239627 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7919c4ccad419a93e82eec1a8961e3" candidate_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c767802094ef44d08661ab90c574255c"
I20260620 09:19:42.240140 10862 raft_consensus.cc:3037] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 1 FOLLOWER]: Advancing to term 2
W20260620 09:19:42.240365 10826 leader_election.cc:341] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255): Illegal state: cannot vote while shut down
I20260620 09:19:42.240682 10826 leader_election.cc:302] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c767802094ef44d08661ab90c574255c; no voters: 16e8f796ce4b4967af930d9ab1d6bfd3, 80e34afeeeed40738e630aeafe0b863a
W20260620 09:19:42.241215 10900 leader_election.cc:341] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255): Illegal state: cannot vote while shut down
I20260620 09:19:42.245090 10862 raft_consensus.cc:2454] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16e8f796ce4b4967af930d9ab1d6bfd3 in term 2.
I20260620 09:19:42.245536 11003 raft_consensus.cc:2726] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 09:19:42.245978 10901 leader_election.cc:302] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16e8f796ce4b4967af930d9ab1d6bfd3, c767802094ef44d08661ab90c574255c; no voters: 80e34afeeeed40738e630aeafe0b863a
I20260620 09:19:42.246824 10998 raft_consensus.cc:2781] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 09:19:42.248235 10998 raft_consensus.cc:686] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 LEADER]: Becoming Leader. State: Replica: 16e8f796ce4b4967af930d9ab1d6bfd3, State: Running, Role: LEADER
I20260620 09:19:42.249182 10998 consensus_queue.cc:237] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e8f796ce4b4967af930d9ab1d6bfd3" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44627 } } peers { permanent_uuid: "80e34afeeeed40738e630aeafe0b863a" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 46255 } } peers { permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 } }
I20260620 09:19:42.712424 10900 consensus_queue.cc:579] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [LEADER]: The tablet replica hosted on peer 80e34afeeeed40738e630aeafe0b863a has failed
W20260620 09:19:42.713013 10900 consensus_peers.cc:487] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 -> Peer 80e34afeeeed40738e630aeafe0b863a (127.9.154.193:46255): Couldn't send request to peer 80e34afeeeed40738e630aeafe0b863a. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:19:42.846941 10862 raft_consensus.cc:1261] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 2 FOLLOWER]: Refusing update from remote peer 16e8f796ce4b4967af930d9ab1d6bfd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 09:19:42.848213 11008 consensus_queue.cc:1035] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c767802094ef44d08661ab90c574255c" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:19:43.025749  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:19:43.044486  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:43.061749  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:19:43.070207  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:19:43.086421  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:43.086984  9835 tablet_replica.cc:330] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c: stopping tablet replica
I20260620 09:19:43.087445  9835 raft_consensus.cc:2229] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 09:19:43.087844  9835 raft_consensus.cc:2258] T 4c7919c4ccad419a93e82eec1a8961e3 P c767802094ef44d08661ab90c574255c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:43.106330  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:19:43.113584  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:19:43.128712  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:43.129492  9835 tablet_replica.cc:330] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3: stopping tablet replica
I20260620 09:19:43.130314  9835 raft_consensus.cc:2229] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 LEADER]: Raft consensus shutting down.
I20260620 09:19:43.131136  9835 raft_consensus.cc:2258] T 4c7919c4ccad419a93e82eec1a8961e3 P 16e8f796ce4b4967af930d9ab1d6bfd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:43.150480  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:19:43.158766  9835 master.cc:537] Master@127.9.154.254:43795 shutting down...
I20260620 09:19:43.173463  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:43.173959  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:43.174294  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 03d4cba2c52745ec956dd0b5a7569c3b: stopping tablet replica
I20260620 09:19:43.191166  9835 master.cc:552] Master@127.9.154.254:43795 shutdown complete.
[       OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (4187 ms)
[ RUN      ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260620 09:19:43.213269  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:33759
I20260620 09:19:43.214371  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:43.219218 11018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.220384 11019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.222095 11021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.222458  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:43.223186  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.223344  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.223520  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183223510 us; error 0 us; skew 500 ppm
I20260620 09:19:43.224067  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.226495  9835 webserver.cc:460] Webserver started at http://127.9.154.254:40495/ using document root <none> and password file <none>
I20260620 09:19:43.226953  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.227128  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:43.227403  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:43.228407  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "930b11d5617d4ded93a0222fa536f78c"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.232584  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260620 09:19:43.235674 11026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.236466  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260620 09:19:43.236847  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "930b11d5617d4ded93a0222fa536f78c"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.237120  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:43.273171  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:43.274317  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:43.312793  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:33759
I20260620 09:19:43.312906 11077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:33759 every 8 connection(s)
I20260620 09:19:43.316570 11078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:43.325578 11078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c: Bootstrap starting.
I20260620 09:19:43.329250 11078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:43.332883 11078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c: No bootstrap required, opened a new log
I20260620 09:19:43.334649 11078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER }
I20260620 09:19:43.335004 11078 raft_consensus.cc:374] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:43.335286 11078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930b11d5617d4ded93a0222fa536f78c, State: Initialized, Role: FOLLOWER
I20260620 09:19:43.335873 11078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER }
I20260620 09:19:43.336300 11078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:19:43.336519 11078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:19:43.336774 11078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:43.341687 11078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER }
I20260620 09:19:43.342378 11078 leader_election.cc:302] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 930b11d5617d4ded93a0222fa536f78c; no voters: 
I20260620 09:19:43.343521 11078 leader_election.cc:288] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:19:43.343844 11081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:43.345350 11081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 1 LEADER]: Becoming Leader. State: Replica: 930b11d5617d4ded93a0222fa536f78c, State: Running, Role: LEADER
I20260620 09:19:43.345942 11081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER }
I20260620 09:19:43.346706 11078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:43.348701 11082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "930b11d5617d4ded93a0222fa536f78c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER } }
I20260620 09:19:43.348737 11083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 930b11d5617d4ded93a0222fa536f78c. Latest consensus state: current_term: 1 leader_uuid: "930b11d5617d4ded93a0222fa536f78c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b11d5617d4ded93a0222fa536f78c" member_type: VOTER } }
I20260620 09:19:43.349485 11082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:43.349653 11083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:43.353483 11086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:43.357872 11086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:43.362442  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:43.366659 11086 catalog_manager.cc:1347] Generated new cluster ID: b491c828ae7f405dbf4710d8cc82c8bc
I20260620 09:19:43.366947 11086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:43.383318 11086 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:43.384838 11086 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:43.394055 11086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c: Generated new TSK 0
I20260620 09:19:43.394690 11086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:43.430107  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:43.436061 11099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.437322 11100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.439044 11102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.439246  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:43.440122  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.440304  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.440426  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183440417 us; error 0 us; skew 500 ppm
I20260620 09:19:43.440896  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.443516  9835 webserver.cc:460] Webserver started at http://127.9.154.193:40967/ using document root <none> and password file <none>
I20260620 09:19:43.444005  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.444205  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:43.444465  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:43.445493  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "e301e9ebe0dd417fa7a421fd824049a0"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.449939  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:19:43.453042 11107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.453853  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:19:43.454161  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "e301e9ebe0dd417fa7a421fd824049a0"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.454519  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:43.481264  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:43.482421  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:43.483919  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:43.486121  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:43.486353  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.486596  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:43.486768  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.528298  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:42465
I20260620 09:19:43.528467 11169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:42465 every 8 connection(s)
I20260620 09:19:43.545416 11170 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33759
I20260620 09:19:43.545840 11170 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:43.546623 11170 heartbeater.cc:511] Master 127.9.154.254:33759 requested a full tablet report, sending...
I20260620 09:19:43.548521 11043 ts_manager.cc:194] Registered new tserver with Master: e301e9ebe0dd417fa7a421fd824049a0 (127.9.154.193:42465)
I20260620 09:19:43.549525  9835 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.017736865s
I20260620 09:19:43.550357 11043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43902
I20260620 09:19:43.572314  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:19:43.586983  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:43.603415  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:19:43.611194  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:19:43.613839  9835 tablet_server.cc:93] deduplicated master addresses: 127.9.154.254:33759
W20260620 09:19:43.617574 11180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.617869 11181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.619103 11183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.620501  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:43.621706  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.621906  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.622028  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183622020 us; error 0 us; skew 500 ppm
I20260620 09:19:43.622625  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.625001  9835 webserver.cc:460] Webserver started at http://127.9.154.193:40967/ using document root <none> and password file <none>
I20260620 09:19:43.625473  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.625622  9835 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 09:19:43.629271  9835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 09:19:43.631948 11188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.632740  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260620 09:19:43.633064  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "e301e9ebe0dd417fa7a421fd824049a0"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.633378  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:43.654359  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:43.655346  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:43.656860  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:43.659243  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:43.659466  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.659699  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:43.659862  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.699695  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:42465
I20260620 09:19:43.699795 11250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:42465 every 8 connection(s)
I20260620 09:19:43.705266  9835 tablet_server.cc:178] TabletServer@127.9.154.193:42465 shutting down...
I20260620 09:19:43.724898 11251 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33759
I20260620 09:19:43.725347 11251 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:43.726861 11251 heartbeater.cc:511] Master 127.9.154.254:33759 requested a full tablet report, sending...
I20260620 09:19:43.729264 11043 ts_manager.cc:194] Re-registered known tserver with Master: e301e9ebe0dd417fa7a421fd824049a0 (127.9.154.193:42465)
I20260620 09:19:43.730813 11043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43914
I20260620 09:19:43.733215  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:19:43.749395  9835 tablet_server.cc:194] TabletServer@127.9.154.193:42465 shutdown complete.
I20260620 09:19:43.756290  9835 master.cc:537] Master@127.9.154.254:33759 shutting down...
I20260620 09:19:43.769908  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:19:43.770485  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:43.770957  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 930b11d5617d4ded93a0222fa536f78c: stopping tablet replica
I20260620 09:19:43.780385  9835 master.cc:552] Master@127.9.154.254:33759 shutdown complete.
[       OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (588 ms)
[ RUN      ] TsTabletManagerITest.TestTableStats
I20260620 09:19:43.801987  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:33389,127.9.154.253:34215,127.9.154.252:38359
I20260620 09:19:43.803164  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:43.807931 11258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.808964 11259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.810473  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:43.811012 11261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.811741  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.811939  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.812114  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183812099 us; error 0 us; skew 500 ppm
I20260620 09:19:43.812630  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.814934  9835 webserver.cc:460] Webserver started at http://127.9.154.254:38623/ using document root <none> and password file <none>
I20260620 09:19:43.815399  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.815593  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:43.815857  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:43.816907  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "c95ff81a1269446382d58a346826f385"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.821069  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:19:43.824432 11266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.825273  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:19:43.825493  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "c95ff81a1269446382d58a346826f385"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.825740  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:43.839531  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:43.840448  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:43.874570  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:33389
I20260620 09:19:43.874686 11317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:33389 every 8 connection(s)
I20260620 09:19:43.878132 11318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:43.878305  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:43.884027 11320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.884155 11321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.886600 11318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:43.890590  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:43.890818 11323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.894467  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.894675  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.894863  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183894852 us; error 0 us; skew 500 ppm
I20260620 09:19:43.895455  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.898088  9835 webserver.cc:460] Webserver started at http://127.9.154.253:35423/ using document root <none> and password file <none>
I20260620 09:19:43.898658  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.898886  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:43.899158  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:43.900308  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-1-root/instance:
uuid: "f002e114dd35409482c513282aa25be7"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.905507  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260620 09:19:43.906353 11318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
W20260620 09:19:43.908974 11268 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.154.253:34215: connect: Connection refused (error 111)
I20260620 09:19:43.909515 11330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:43.910632  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 09:19:43.911161  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-1-root
uuid: "f002e114dd35409482c513282aa25be7"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.911500  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260620 09:19:43.913000 11318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.253:34215: Network error: Client connection negotiation failed: client connection to 127.9.154.253:34215: connect: Connection refused (error 111)
I20260620 09:19:43.925254  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:43.926477  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:43.951560 11318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } attempt: 1
W20260620 09:19:43.956192 11318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.253:34215: Network error: Client connection negotiation failed: client connection to 127.9.154.253:34215: connect: Connection refused (error 111)
I20260620 09:19:43.965715  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.253:34215
I20260620 09:19:43.965785 11382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.253:34215 every 8 connection(s)
I20260620 09:19:43.969362  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:19:43.969674 11383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 09:19:43.974732 11385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:43.975500 11386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.977182 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } has no permanent_uuid. Determining permanent_uuid...
W20260620 09:19:43.980698 11389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:43.980935  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:43.981757  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:43.981984  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:43.982174  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947183982158 us; error 0 us; skew 500 ppm
I20260620 09:19:43.982883  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:43.985581  9835 webserver.cc:460] Webserver started at http://127.9.154.252:46675/ using document root <none> and password file <none>
I20260620 09:19:43.986168  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:43.986418  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:43.986723  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:43.987804  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root/instance:
uuid: "a2eed4714a794104931a9474b72da8f1"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:43.992688 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:43.993415  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260620 09:19:43.996659 11318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } attempt: 2
I20260620 09:19:44.006409 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:44.012689 11395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.014217  9835 fs_manager.cc:725] Time spent opening block manager: real 0.018s	user 0.014s	sys 0.003s
I20260620 09:19:44.014621  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
uuid: "a2eed4714a794104931a9474b72da8f1"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:44.014943  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:44.016358 11318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
W20260620 09:19:44.017289 11383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.252:38359: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
W20260620 09:19:44.021157 11318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.252:38359: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
I20260620 09:19:44.029587  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:44.030730  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:44.052829 11383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } attempt: 1
I20260620 09:19:44.054888 11318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } attempt: 1
W20260620 09:19:44.058091 11383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.252:38359: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
W20260620 09:19:44.060101 11318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.154.252:38359: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
I20260620 09:19:44.072688  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.252:38359
I20260620 09:19:44.072784 11448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.252:38359 every 8 connection(s)
I20260620 09:19:44.075717  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:19:44.076618 11449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.081801 11449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:44.094018 11449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:44.098596 11318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } attempt: 2
I20260620 09:19:44.107913 11449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
I20260620 09:19:44.118811 11318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Bootstrap starting.
I20260620 09:19:44.123675 11318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:44.127360 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Bootstrap starting.
I20260620 09:19:44.127748 11318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: No bootstrap required, opened a new log
I20260620 09:19:44.129504 11318 raft_consensus.cc:348] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.130204 11318 raft_consensus.cc:374] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:44.130534 11318 raft_consensus.cc:729] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95ff81a1269446382d58a346826f385, State: Initialized, Role: FOLLOWER
I20260620 09:19:44.131217 11318 consensus_queue.cc:260] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.131996 11449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:44.133213 11455 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.133670 11383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } attempt: 2
I20260620 09:19:44.134119 11455 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.135016 11318 sys_catalog.cc:564] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:44.137102 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: No bootstrap required, opened a new log
I20260620 09:19:44.139093 11449 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.139901 11449 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:44.140223 11449 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2eed4714a794104931a9474b72da8f1, State: Initialized, Role: FOLLOWER
I20260620 09:19:44.141037 11449 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.147256 11461 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.148926 11461 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.149233 11449 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:44.158893 11383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Bootstrap starting.
I20260620 09:19:44.159854  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260620 09:19:44.164644 11473 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 09:19:44.164987 11473 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 09:19:44.165182 11383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:44.170143 11383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: No bootstrap required, opened a new log
I20260620 09:19:44.172506 11383 raft_consensus.cc:348] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.173182 11383 raft_consensus.cc:374] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:44.173447 11383 raft_consensus.cc:729] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f002e114dd35409482c513282aa25be7, State: Initialized, Role: FOLLOWER
W20260620 09:19:44.173540 11480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 09:19:44.173847 11480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 09:19:44.174866 11383 consensus_queue.cc:260] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.175487 11481 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:44.175946 11481 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.177069 11482 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.177726 11482 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.178499 11383 sys_catalog.cc:564] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:44.179243 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:19:44.179896 11424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1" is_pre_election: true
I20260620 09:19:44.180071 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 0.
I20260620 09:19:44.180532 11424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 0.
I20260620 09:19:44.179288 11481 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:44.181305 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: 
I20260620 09:19:44.182056 11481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:19:44.182492 11481 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:44.182907 11481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:44.190882 11481 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.193141 11481 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 1 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:44.193869 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385"
I20260620 09:19:44.194378 11293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:44.194195 11424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1"
I20260620 09:19:44.194942 11424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:44.199028 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 1.
I20260620 09:19:44.200148 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: 
I20260620 09:19:44.200901  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260620 09:19:44.200928 11481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:44.201532 11481 raft_consensus.cc:686] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 LEADER]: Becoming Leader. State: Replica: f002e114dd35409482c513282aa25be7, State: Running, Role: LEADER
I20260620 09:19:44.202533 11424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 1.
I20260620 09:19:44.202742  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:19:44.202344 11481 consensus_queue.cc:237] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:44.207413 11482 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.208159 11482 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
W20260620 09:19:44.210662 11493 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 09:19:44.211184 11493 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 09:19:44.212683 11496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260620 09:19:44.215811 11495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:44.220674 11497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.221359 11496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:44.228824  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:44.229593 11499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.230506  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:44.230741  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:44.230922  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947184230907 us; error 0 us; skew 500 ppm
I20260620 09:19:44.231591  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:44.233388 11424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Refusing update from remote peer f002e114dd35409482c513282aa25be7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 09:19:44.233767 11293 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Refusing update from remote peer f002e114dd35409482c513282aa25be7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 09:19:44.235119 11481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:44.235874 11482 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 09:19:44.236317  9835 webserver.cc:460] Webserver started at http://127.9.154.193:44839/ using document root <none> and password file <none>
I20260620 09:19:44.237020  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:44.237289  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:44.237690  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:44.239054  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "369e0e637f7b495d954f88956390d6eb"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.250581 11461 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.251699 11461 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.253386  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.014s	user 0.005s	sys 0.009s
I20260620 09:19:44.254617 11455 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.255411 11455 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.261039 11504 mvcc.cc:205] Tried to move back new op lower bound from 7298855666607362048 to 7298855666501136384. Current Snapshot: MvccSnapshot[applied={T|T < 7298855666607362048}]
I20260620 09:19:44.266861 11511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.268193  9835 fs_manager.cc:725] Time spent opening block manager: real 0.011s	user 0.003s	sys 0.005s
I20260620 09:19:44.268800  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "369e0e637f7b495d954f88956390d6eb"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.269413  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:44.270848 11496 catalog_manager.cc:1347] Generated new cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:44.271248 11496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:44.276389 11461 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.277128 11461 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.286378 11455 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.287421 11455 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:44.288968 11482 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.289263 11481 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:44.289708 11482 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:44.289942 11481 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:44.301554  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:44.302757  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:44.304212  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:44.306702  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:44.306915  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.307193  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:44.307372  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.321548 11496 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:19:44.324138 11496 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:44.355978 11496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Generated new TSK 0
I20260620 09:19:44.357065 11496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:44.374446  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:44211
I20260620 09:19:44.374890 11575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:44211 every 8 connection(s)
I20260620 09:19:44.386049  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:44.397656 11583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.407493 11576 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
W20260620 09:19:44.407660 11586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.407948 11576 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.409058 11576 heartbeater.cc:511] Master 127.9.154.252:38359 requested a full tablet report, sending...
W20260620 09:19:44.409776 11584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.410923  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:44.411866  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:44.412079  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:44.412262  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947184412246 us; error 0 us; skew 500 ppm
I20260620 09:19:44.412340 11414 ts_manager.cc:194] Registered new tserver with Master: 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211)
I20260620 09:19:44.412883  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:44.417663 11578 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:44.418009 11578 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.418012 11577 heartbeater.cc:347] Connected to a master server at 127.9.154.253:34215
I20260620 09:19:44.418610 11577 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.418779 11578 heartbeater.cc:511] Master 127.9.154.254:33389 requested a full tablet report, sending...
I20260620 09:19:44.419620 11577 heartbeater.cc:511] Master 127.9.154.253:34215 requested a full tablet report, sending...
I20260620 09:19:44.421960 11348 ts_manager.cc:194] Registered new tserver with Master: 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211)
I20260620 09:19:44.422411 11283 ts_manager.cc:194] Registered new tserver with Master: 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211)
I20260620 09:19:44.424556 11348 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42952
I20260620 09:19:44.424628  9835 webserver.cc:460] Webserver started at http://127.9.154.194:33103/ using document root <none> and password file <none>
I20260620 09:19:44.425287  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:44.425545  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:44.425959  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:44.427511  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.431802  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:19:44.436160 11591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.437136  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260620 09:19:44.437422  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.437759  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:44.461822  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:44.463106  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:44.465315  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:44.468396  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:44.468626  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.468885  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:44.469051  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.528013 11577 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:44.560497  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:35385
I20260620 09:19:44.560593 11653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:35385 every 8 connection(s)
I20260620 09:19:44.579141  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:19:44.591030 11654 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
I20260620 09:19:44.591446 11654 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.592381 11654 heartbeater.cc:511] Master 127.9.154.252:38359 requested a full tablet report, sending...
W20260620 09:19:44.595999 11661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.598037 11414 ts_manager.cc:194] Registered new tserver with Master: 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
W20260620 09:19:44.598901 11662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.604657  9835 server_base.cc:1034] running on GCE node
W20260620 09:19:44.604714 11664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:44.606112  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:44.606429  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:44.606678  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947184606660 us; error 0 us; skew 500 ppm
I20260620 09:19:44.607463  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:44.610656  9835 webserver.cc:460] Webserver started at http://127.9.154.195:36587/ using document root <none> and password file <none>
I20260620 09:19:44.610793 11655 heartbeater.cc:347] Connected to a master server at 127.9.154.253:34215
I20260620 09:19:44.611229 11655 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.612402 11655 heartbeater.cc:511] Master 127.9.154.253:34215 requested a full tablet report, sending...
I20260620 09:19:44.612459  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:44.613023  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:19:44.613384  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:19:44.614709 11348 ts_manager.cc:194] Registered new tserver with Master: 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:44.614997  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-2-root/instance:
uuid: "e7db1005e2084c07b1c950f00bcdae65"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.616654 11348 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42968
I20260620 09:19:44.616885 11656 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:44.617276 11656 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.618018 11656 heartbeater.cc:511] Master 127.9.154.254:33389 requested a full tablet report, sending...
I20260620 09:19:44.621011 11283 ts_manager.cc:194] Registered new tserver with Master: 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:44.627019  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.011s	user 0.011s	sys 0.000s
I20260620 09:19:44.631110 11669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.632258  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260620 09:19:44.632576  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-2-root
uuid: "e7db1005e2084c07b1c950f00bcdae65"
format_stamp: "Formatted at 2026-06-20 09:19:44 on dist-test-slave-zmgx"
I20260620 09:19:44.632939  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:44.651330  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:44.652611  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:44.653834  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:19:44.655942  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:19:44.656190  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.656453  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:19:44.656646  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:44.719887 11655 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:44.744484  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.195:44545
I20260620 09:19:44.744602 11731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.195:44545 every 8 connection(s)
I20260620 09:19:44.775624 11733 heartbeater.cc:347] Connected to a master server at 127.9.154.253:34215
I20260620 09:19:44.776051 11733 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.776902 11733 heartbeater.cc:511] Master 127.9.154.253:34215 requested a full tablet report, sending...
I20260620 09:19:44.776908 11732 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
I20260620 09:19:44.777381 11732 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.778630 11732 heartbeater.cc:511] Master 127.9.154.252:38359 requested a full tablet report, sending...
I20260620 09:19:44.779436 11348 ts_manager.cc:194] Registered new tserver with Master: e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:44.780522 11735 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:44.780906 11735 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:44.781131 11414 ts_manager.cc:194] Registered new tserver with Master: e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:44.781507 11348 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42972
I20260620 09:19:44.781737 11735 heartbeater.cc:511] Master 127.9.154.254:33389 requested a full tablet report, sending...
I20260620 09:19:44.783869 11283 ts_manager.cc:194] Registered new tserver with Master: e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:44.784123  9835 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.029331455s
I20260620 09:19:44.836752 11348 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42986:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  hash_schema {
    columns {
      name: "key"
    }
    num_buckets: 3
    seed: 0
  }
}
W20260620 09:19:44.838579 11348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 09:19:44.884482 11733 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:44.926828 11541 tablet_service.cc:1467] Processing CreateTablet for tablet eabae62ae6d2445ab10d90110f48b994 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.927542 11540 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.928663 11541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eabae62ae6d2445ab10d90110f48b994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.929299 11540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.930552 11539 tablet_service.cc:1467] Processing CreateTablet for tablet 3bb66132f9704f729546842b96e39111 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.932240 11539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bb66132f9704f729546842b96e39111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.939388 11697 tablet_service.cc:1467] Processing CreateTablet for tablet eabae62ae6d2445ab10d90110f48b994 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.940431 11697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eabae62ae6d2445ab10d90110f48b994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.951388 11696 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.952744 11696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.956169 11619 tablet_service.cc:1467] Processing CreateTablet for tablet eabae62ae6d2445ab10d90110f48b994 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.957108 11618 tablet_service.cc:1467] Processing CreateTablet for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.956162 11695 tablet_service.cc:1467] Processing CreateTablet for tablet 3bb66132f9704f729546842b96e39111 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.959061 11695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bb66132f9704f729546842b96e39111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.960669 11617 tablet_service.cc:1467] Processing CreateTablet for tablet 3bb66132f9704f729546842b96e39111 (DEFAULT_TABLE table=test-table [id=b3436dce7a214ad3a3c0cc674222084b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260620 09:19:44.957715 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eabae62ae6d2445ab10d90110f48b994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.966817 11618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.971560 11617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bb66132f9704f729546842b96e39111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:19:44.975411 11755 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: Bootstrap starting.
I20260620 09:19:44.988867 11755 tablet_bootstrap.cc:654] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:44.997478 11756 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: Bootstrap starting.
I20260620 09:19:45.006834 11757 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: Bootstrap starting.
I20260620 09:19:45.010993 11756 tablet_bootstrap.cc:654] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.013849 11755 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: No bootstrap required, opened a new log
I20260620 09:19:45.014400 11755 ts_tablet_manager.cc:1397] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260620 09:19:45.016327 11757 tablet_bootstrap.cc:654] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.020838 11755 raft_consensus.cc:348] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.021927 11755 raft_consensus.cc:374] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.022277 11755 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.023058 11755 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.024273 11756 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: No bootstrap required, opened a new log
I20260620 09:19:45.024758 11756 ts_tablet_manager.cc:1397] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260620 09:19:45.025080 11757 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: No bootstrap required, opened a new log
I20260620 09:19:45.025549 11757 ts_tablet_manager.cc:1397] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.013s
I20260620 09:19:45.027262 11755 ts_tablet_manager.cc:1428] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260620 09:19:45.028258 11756 raft_consensus.cc:348] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.029008 11756 raft_consensus.cc:374] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.028733 11757 raft_consensus.cc:348] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.029292 11756 raft_consensus.cc:729] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.029465 11757 raft_consensus.cc:374] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.029758 11757 raft_consensus.cc:729] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fdaefc8a1b44e4b64fc41474ee4d77, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.030275 11755 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: Bootstrap starting.
I20260620 09:19:45.030424 11757 consensus_queue.cc:260] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.030049 11756 consensus_queue.cc:260] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.038868 11755 tablet_bootstrap.cc:654] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.059353 11756 ts_tablet_manager.cc:1428] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.007s
I20260620 09:19:45.060837 11756 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: Bootstrap starting.
I20260620 09:19:45.073499 11757 ts_tablet_manager.cc:1428] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.032s
I20260620 09:19:45.075956 11762 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.076401 11757 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: Bootstrap starting.
I20260620 09:19:45.078971 11763 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.079453 11763 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.076436 11762 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.083132 11756 tablet_bootstrap.cc:654] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.084753 11763 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.095700 11762 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:45.165800 11757 tablet_bootstrap.cc:654] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.166592 11755 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: No bootstrap required, opened a new log
I20260620 09:19:45.167198 11755 ts_tablet_manager.cc:1397] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: Time spent bootstrapping tablet: real 0.137s	user 0.047s	sys 0.079s
I20260620 09:19:45.177081 11473 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:45.177201 11761 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.183149 11761 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.178339 11473 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: loading cluster ID for follower catalog manager: success
I20260620 09:19:45.188690 11480 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:45.195318 11755 raft_consensus.cc:348] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.196125 11755 raft_consensus.cc:374] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.196518 11755 raft_consensus.cc:729] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.197176 11755 consensus_queue.cc:260] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.187641 11761 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:45.192878 11480 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: loading cluster ID for follower catalog manager: success
I20260620 09:19:45.205041 11629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
W20260620 09:19:45.208555 11672 leader_election.cc:341] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Illegal state: must be running to vote when last-logged opid is not known
I20260620 09:19:45.223778 11761 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.224422 11761 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.238175 11761 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:45.266189 11473 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: acquiring CA information for follower catalog manager: success
I20260620 09:19:45.296888 11756 tablet_bootstrap.cc:492] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: No bootstrap required, opened a new log
I20260620 09:19:45.304594 11756 ts_tablet_manager.cc:1397] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: Time spent bootstrapping tablet: real 0.244s	user 0.022s	sys 0.033s
I20260620 09:19:45.319296 11756 raft_consensus.cc:348] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.320091 11756 raft_consensus.cc:374] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.320421 11473 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 09:19:45.320394 11756 raft_consensus.cc:729] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.327899 11755 ts_tablet_manager.cc:1428] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: Time spent starting tablet: real 0.150s	user 0.011s	sys 0.013s
I20260620 09:19:45.322016 11756 consensus_queue.cc:260] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.340693 11755 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Bootstrap starting.
I20260620 09:19:45.349260 11763 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.349908 11763 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.358915 11756 ts_tablet_manager.cc:1428] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260620 09:19:45.360674 11763 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.363596 11629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:45.364464 11629 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 0.
I20260620 09:19:45.365749 11755 tablet_bootstrap.cc:654] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.365939 11672 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:45.368701 11763 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:19:45.369069 11763 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:45.369396 11763 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.378082 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:45.378856 11550 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 0.
I20260620 09:19:45.377086 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
W20260620 09:19:45.382614 11592 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.154.193:44211, user_credentials={real_user=slave}} blocked reactor thread for 57681.4us
I20260620 09:19:45.383364 11755 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: No bootstrap required, opened a new log
I20260620 09:19:45.383888 11755 ts_tablet_manager.cc:1397] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.014s
I20260620 09:19:45.384753 11763 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.386150 11480 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: acquiring CA information for follower catalog manager: success
I20260620 09:19:45.386585 11755 raft_consensus.cc:348] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.387305 11757 tablet_bootstrap.cc:492] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: No bootstrap required, opened a new log
I20260620 09:19:45.387326 11755 raft_consensus.cc:374] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.387645 11756 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: Bootstrap starting.
I20260620 09:19:45.387831 11757 ts_tablet_manager.cc:1397] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent bootstrapping tablet: real 0.312s	user 0.068s	sys 0.090s
I20260620 09:19:45.387835 11755 raft_consensus.cc:729] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.388852 11755 consensus_queue.cc:260] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.396564 11629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:45.397264 11629 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.401896 11480 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 09:19:45.404352 11755 ts_tablet_manager.cc:1428] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260620 09:19:45.406586 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:45.398811 11763 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.408006 11551 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.408336 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:45.413702 11756 tablet_bootstrap.cc:654] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.414746 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:45.416163 11706 raft_consensus.cc:2379] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in current term 1: Already voted for candidate e7db1005e2084c07b1c950f00bcdae65 in this term.
I20260620 09:19:45.410192 11707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:45.421698 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:45.421530 11757 raft_consensus.cc:348] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.423761 11549 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 0.
I20260620 09:19:45.423863 11757 raft_consensus.cc:374] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.424358 11757 raft_consensus.cc:729] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fdaefc8a1b44e4b64fc41474ee4d77, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.436594 11592 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:45.436954 11670 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77
I20260620 09:19:45.427088 11757 consensus_queue.cc:260] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.437968 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:45.438267 11763 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:19:45.440963 11706 raft_consensus.cc:2379] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 1: Already voted for candidate e7db1005e2084c07b1c950f00bcdae65 in this term.
W20260620 09:19:45.444993 11514 leader_election.cc:341] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545): Illegal state: must be running to vote when last-logged opid is not known
I20260620 09:19:45.446768 11757 ts_tablet_manager.cc:1428] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.003s
I20260620 09:19:45.448724 11757 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: Bootstrap starting.
I20260620 09:19:45.439620 11763 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:45.452602 11763 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.455103 11629 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.456724 11762 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 09:19:45.459041 11672 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:45.462461 11763 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.464180 11763 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.464679 11763 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:45.465116 11763 raft_consensus.cc:686] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:45.465010 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:45.465713 11550 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.465976 11763 consensus_queue.cc:237] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.510679 11777 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.510762 11551 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.512467 11777 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.513808 11550 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.515316 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:45.516057 11550 raft_consensus.cc:2379] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in current term 1: Already voted for candidate e7db1005e2084c07b1c950f00bcdae65 in this term.
I20260620 09:19:45.516167 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:45.516940 11706 raft_consensus.cc:2379] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in current term 1: Already voted for candidate e7db1005e2084c07b1c950f00bcdae65 in this term.
I20260620 09:19:45.517088 11757 tablet_bootstrap.cc:654] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: Neither blocks nor log segments found. Creating new log.
I20260620 09:19:45.517848 11592 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:45.519598 11762 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Advancing to term 1
W20260620 09:19:45.518358 11672 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.154.194:35385, user_credentials={real_user=slave}} blocked reactor thread for 59923.8us
I20260620 09:19:45.522014 11670 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:45.523039 11629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:45.524605 11763 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:45.518616 11777 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:45.533859 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:45.534744 11628 raft_consensus.cc:2379] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 1: Already voted for candidate e7db1005e2084c07b1c950f00bcdae65 in this term.
I20260620 09:19:45.534783 11756 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: No bootstrap required, opened a new log
I20260620 09:19:45.535418 11756 ts_tablet_manager.cc:1397] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.050s
I20260620 09:19:45.531338 11347 catalog_manager.cc:5495] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195). New cstate: current_term: 1 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:45.537846 11762 raft_consensus.cc:2726] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 09:19:45.537938 11756 raft_consensus.cc:348] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.538798 11756 raft_consensus.cc:374] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.540081 11756 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.530409 11763 raft_consensus.cc:686] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:45.542086 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:45.541832 11763 consensus_queue.cc:237] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:45.548786 11629 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.550246 11516 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:45.551944 11773 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 09:19:45.555372 11756 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
W20260620 09:19:45.560168 11516 leader_election.cc:341] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Illegal state: must be running to vote when last-logged opid is not known
I20260620 09:19:45.560609 11516 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:45.561501 11773 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 09:19:45.565361 11756 ts_tablet_manager.cc:1428] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.005s
I20260620 09:19:45.567665 11757 tablet_bootstrap.cc:492] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: No bootstrap required, opened a new log
I20260620 09:19:45.568101 11757 ts_tablet_manager.cc:1397] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.005s
I20260620 09:19:45.573740 11763 consensus_queue.cc:1035] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:45.572444 11757 raft_consensus.cc:348] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.586696 11757 raft_consensus.cc:374] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:19:45.588464 11757 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fdaefc8a1b44e4b64fc41474ee4d77, State: Initialized, Role: FOLLOWER
I20260620 09:19:45.593839 11346 catalog_manager.cc:5495] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195). New cstate: current_term: 1 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: UNKNOWN } } }
I20260620 09:19:45.600719 11763 consensus_queue.cc:1035] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:45.631829 11782 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:45.632740 11782 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.637006 11782 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.589358 11757 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.637612 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:45.638556 11628 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 0.
I20260620 09:19:45.640367 11757 ts_tablet_manager.cc:1428] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.005s
I20260620 09:19:45.641526 11672 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:45.643316 11779 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:19:45.643692 11779 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:45.644038 11779 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.636932 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:45.646373 11550 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 0.
I20260620 09:19:45.657202 11779 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.657703 11763 consensus_queue.cc:1035] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 09:19:45.664341 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:45.665092 11628 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.665793 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:45.666445 11550 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:19:45.671559 11779 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:45.677256 11779 consensus_queue.cc:1035] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 09:19:45.689711 11550 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.694048 11628 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 1.
I20260620 09:19:45.695327 11672 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:45.696267 11763 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:19:45.696771 11763 raft_consensus.cc:686] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:45.697432 11763 consensus_queue.cc:237] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:45.711476 11348 catalog_manager.cc:5495] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195). New cstate: current_term: 1 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:45.799258 11779 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:19:45.817692 11763 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 09:19:46.381096 11706 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3bb66132f9704f729546842b96e39111"
dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
 from {username='slave'} at 127.0.0.1:45324
I20260620 09:19:46.381726 11706 raft_consensus.cc:580] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Received request to step down
I20260620 09:19:46.381980 11706 raft_consensus.cc:3032] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:46.382297 11706 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:46.383080 11706 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.384397 11706 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.502159 11824 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.503118 11824 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.504683 11824 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.505546 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:46.505738 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:46.506371 11706 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 2.
I20260620 09:19:46.507366 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:19:46.508067 11824 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:46.508455 11824 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.508846 11824 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.515673 11824 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.517760 11824 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.518733 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:19:46.518843 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:46.524086 11706 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 2.
I20260620 09:19:46.524971 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:19:46.526140 11824 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 09:19:46.527375 11824 raft_consensus.cc:686] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 LEADER]: Becoming Leader. State: Replica: 89fdaefc8a1b44e4b64fc41474ee4d77, State: Running, Role: LEADER
I20260620 09:19:46.528371 11824 consensus_queue.cc:237] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.535868 11347 catalog_manager.cc:5495] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 reported cstate change: term changed from 1 to 2, leader changed from e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195) to 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194). New cstate: current_term: 2 leader_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: UNKNOWN } } }
I20260620 09:19:46.547431 11828 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.548015 11828 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.551043 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:46.552178 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:46.551950 11828 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.552928 11706 raft_consensus.cc:2379] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 2: Already voted for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in this term.
I20260620 09:19:46.553905 11514 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:46.555100 11828 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.561579 11828 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 09:19:46.599227 11706 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13"
dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
 from {username='slave'} at 127.0.0.1:45324
I20260620 09:19:46.599851 11706 raft_consensus.cc:580] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Received request to step down
I20260620 09:19:46.600188 11706 raft_consensus.cc:3032] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:46.600479 11706 raft_consensus.cc:729] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:46.601244 11706 consensus_queue.cc:260] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.602453 11706 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.609578 11706 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Refusing update from remote peer 89fdaefc8a1b44e4b64fc41474ee4d77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 09:19:46.610986 11824 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:46.621399 11551 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Refusing update from remote peer 89fdaefc8a1b44e4b64fc41474ee4d77: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 09:19:46.623310 11824 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:46.764427 11825 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.765177 11825 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.767875 11825 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.770292 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:46.816435 11835 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.817221 11835 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.821154 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:46.821934 11627 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 1.
I20260620 09:19:46.823510 11516 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 
I20260620 09:19:46.824470 11828 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:46.824824 11828 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.825173 11828 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.854734 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:46.855633 11706 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 2.
I20260620 09:19:46.857268 11592 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:19:46.858776 11824 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:46.859244 11824 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:46.859702 11824 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:46.869366 11824 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.916728 11835 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.990161 11835 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89fdaefc8a1b44e4b64fc41474ee4d77)
I20260620 09:19:46.990955 11835 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:46.993556 11835 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.994511 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:47.017102 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:19:47.020876 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f002e114dd35409482c513282aa25be7)
I20260620 09:19:47.021428 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.023141 11824 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:46.965164 11828 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.024139 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:47.025468 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:19:47.026165 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2eed4714a794104931a9474b72da8f1 in term 1.
I20260620 09:19:47.026456 11707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:47.027937 11401 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, c95ff81a1269446382d58a346826f385; no voters: 
I20260620 09:19:47.028642 11837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:47.029038 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f002e114dd35409482c513282aa25be7)
I20260620 09:19:47.029479 11837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:47.029325 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:47.030463 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:47.031481 11551 raft_consensus.cc:2379] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in current term 2: Already voted for candidate 369e0e637f7b495d954f88956390d6eb in this term.
I20260620 09:19:47.312883 11705 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994"
dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
 from {username='slave'} at 127.0.0.1:45324
I20260620 09:19:47.313511 11705 raft_consensus.cc:580] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Received request to step down
I20260620 09:19:47.313848 11705 raft_consensus.cc:3032] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:47.314133 11705 raft_consensus.cc:729] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:47.314915 11705 consensus_queue.cc:260] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.328660 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:47.338281 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.340683 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 2 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:47.341378 11706 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 2.
W20260620 09:19:47.341864 11706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57826 (request call id 12) took 326 ms (client timeout 246 ms). Trace:
I20260620 09:19:47.343386 11763 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:47.345953 11763 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.348269 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7"
I20260620 09:19:47.352631 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:47.348881 11828 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 election: Requested vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
W20260620 09:19:47.355952 11706 rpcz_store.cc:269] 0620 09:19:47.014995 (+     0us) service_pool.cc:170] Inserting onto call queue
0620 09:19:47.016565 (+  1570us) service_pool.cc:227] Handling call
0620 09:19:47.341803 (+325238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37888}
I20260620 09:19:47.448156 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385"
I20260620 09:19:47.449743 11401 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2eed4714a794104931a9474b72da8f1; no voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7
I20260620 09:19:47.450691 11837 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 09:19:47.495128 11424 raft_consensus.cc:1226] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Rejecting Update request from peer f002e114dd35409482c513282aa25be7 for earlier term 1. Current term is 2. Ops: []
I20260620 09:19:47.497654 11481 consensus_queue.cc:1046] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 }, Status: INVALID_TERM, Last received: 1.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 09:19:47.498557 11481 raft_consensus.cc:3032] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 09:19:47.498627 11838 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:47.498878 11481 raft_consensus.cc:729] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f002e114dd35409482c513282aa25be7, State: Running, Role: LEADER
I20260620 09:19:47.499261 11838 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.500161 11481 consensus_queue.cc:260] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.501410 11481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:47.501617 11838 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
W20260620 09:19:47.505860 11514 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.154.195:44545, user_credentials={real_user=slave}} blocked reactor thread for 469309us
I20260620 09:19:47.507634 11514 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:47.509497 11836 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 09:19:47.510133 11836 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:47.510627 11836 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.512657 11836 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
W20260620 09:19:47.516083 11671 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.154.253:34215, user_credentials={real_user=slave}} blocked reactor thread for 174164us
I20260620 09:19:47.526283 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:47.529016 11628 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 1.
I20260620 09:19:47.529263 11841 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89fdaefc8a1b44e4b64fc41474ee4d77)
I20260620 09:19:47.527347 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:47.530244 11627 raft_consensus.cc:2379] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 2: Already voted for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in this term.
I20260620 09:19:47.529928 11841 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.531278 11516 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 
I20260620 09:19:47.532027 11841 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.533166 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:47.533694 11551 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 2.
I20260620 09:19:47.535800 11670 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:47.536774 11836 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 09:19:47.537153 11836 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:19:47.537508 11836 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:47.537796 11842 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 09:19:47.538245 11842 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89fdaefc8a1b44e4b64fc41474ee4d77)
I20260620 09:19:47.538615 11842 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.544530 11763 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.546195 11836 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.546200 11842 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.549022 11842 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.549163 11836 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 election: Requested vote from peers e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.551024 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:47.551427 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:47.551651 11627 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:47.552013 11551 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 2.
I20260620 09:19:47.553674 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:47.554255 11551 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.554595 11670 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:47.555563 11842 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 09:19:47.555936 11842 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:47.556269 11842 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.559166 11704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:19:47.562168 11629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:47.562664 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:19:47.562832 11629 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 2.
I20260620 09:19:47.563591 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:47.563738 11842 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.564904 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:47.566193 11842 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.566716 11707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:47.567184 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:47.567258 11627 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 2.
I20260620 09:19:47.567843 11549 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.569113 11706 raft_consensus.cc:2354] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb for earlier term 2. Current term is 3.
I20260620 09:19:47.570119 11516 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 
I20260620 09:19:47.571024 11828 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Leader election won for term 2
I20260620 09:19:47.571487 11828 raft_consensus.cc:686] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 LEADER]: Becoming Leader. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Running, Role: LEADER
I20260620 09:19:47.572297 11828 consensus_queue.cc:237] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.574755 11514 leader_election.cc:398] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 election: Vote denied by peer e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545) with higher term. Message: Invalid argument: T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb for earlier term 2. Current term is 3.
I20260620 09:19:47.575058 11514 leader_election.cc:401] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260620 09:19:47.576551 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:47.577118 11627 raft_consensus.cc:3037] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.580391 11705 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:19:47.580782 11549 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 3.
I20260620 09:19:47.581161 11763 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:47.581297 11836 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545) with higher term. Message: Invalid argument: T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb for earlier term 2. Current term is 3.
I20260620 09:19:47.581604 11763 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.583451 11670 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 
I20260620 09:19:47.584435 11779 raft_consensus.cc:2781] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 09:19:47.584884 11779 raft_consensus.cc:686] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:47.585654 11779 consensus_queue.cc:237] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.589097 11704 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 2.
I20260620 09:19:47.592198 11627 raft_consensus.cc:2454] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 3.
W20260620 09:19:47.583088 11592 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.154.195:44545, user_credentials={real_user=slave}} blocked reactor thread for 406370us
I20260620 09:19:47.601431 11763 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.603104 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:47.603813 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:19:47.604404 11627 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 2.
I20260620 09:19:47.605677 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:19:47.607859 11672 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:19:47.609006 11763 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 09:19:47.609431 11763 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:47.609846 11763 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.611132 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:19:47.613116 11706 raft_consensus.cc:1226] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Rejecting Update request from peer 89fdaefc8a1b44e4b64fc41474ee4d77 for earlier term 2. Current term is 3. Ops: []
I20260620 09:19:47.614949 11825 consensus_queue.cc:1046] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:19:47.615988 11838 raft_consensus.cc:3032] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 09:19:47.616154 11592 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:47.616375 11838 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89fdaefc8a1b44e4b64fc41474ee4d77, State: Running, Role: LEADER
I20260620 09:19:47.616885 11825 raft_consensus.cc:2726] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 09:19:47.617203 11838 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.618105 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:19:47.618361 11838 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.618098 11763 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.619829 11592 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:19:47.622323 11763 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:47.622382 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:19:47.622560 11627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:19:47.623358 11627 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.621093 11825 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 09:19:47.626902 11551 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 3.
I20260620 09:19:47.627597 11549 raft_consensus.cc:1226] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Rejecting Update request from peer 89fdaefc8a1b44e4b64fc41474ee4d77 for earlier term 2. Current term is 3. Ops: []
I20260620 09:19:47.628051 11670 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77
I20260620 09:19:47.629419 11763 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 09:19:47.631660 11763 raft_consensus.cc:686] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:47.632278 11763 consensus_queue.cc:237] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:19:47.633253 11627 raft_consensus.cc:2454] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7db1005e2084c07b1c950f00bcdae65 in term 3.
I20260620 09:19:47.634642 11672 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:19:47.636031 11840 raft_consensus.cc:2781] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 09:19:47.636521 11840 raft_consensus.cc:686] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Becoming Leader. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:19:47.637316 11840 consensus_queue.cc:237] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.663209 11704 raft_consensus.cc:1226] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Rejecting Update request from peer 369e0e637f7b495d954f88956390d6eb for earlier term 2. Current term is 3. Ops: []
I20260620 09:19:47.664825 11828 consensus_queue.cc:1046] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:47.665494 11828 consensus_queue.cc:1225] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Peer e7db1005e2084c07b1c950f00bcdae65 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260620 09:19:47.666143 11844 raft_consensus.cc:3032] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 LEADER]: Stepping down as leader of term 2
I20260620 09:19:47.666535 11844 raft_consensus.cc:729] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Running, Role: LEADER
I20260620 09:19:47.667205 11844 consensus_queue.cc:260] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:19:47.668200 11844 raft_consensus.cc:3037] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.694581 11627 raft_consensus.cc:1261] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 09:19:47.696120 11840 consensus_queue.cc:1035] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:47.699294 11549 raft_consensus.cc:1261] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 09:19:47.701028 11763 consensus_queue.cc:1035] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:47.706122 11510 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:47.706808 11510 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.712994 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:47.713502 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.725503 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:19:47.726209 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2eed4714a794104931a9474b72da8f1 in term 1.
I20260620 09:19:47.727578 11401 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, c95ff81a1269446382d58a346826f385; no voters: 
I20260620 09:19:47.728506 11510 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:47.729457 11626 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 09:19:47.730141 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:19:47.730757 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 1.
I20260620 09:19:47.731173 11840 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:19:47.731990 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:47.732360 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: 
I20260620 09:19:47.732954 11837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 09:19:47.733306 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:47.733345 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:47.733749 11837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.734048 11358 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2eed4714a794104931a9474b72da8f1 in term 2.
I20260620 09:19:47.736025 11510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 09:19:47.736460 11510 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:47.736841 11510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 2 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.746958 11628 raft_consensus.cc:1261] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 09:19:47.748507 11840 consensus_queue.cc:1035] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:47.757668 11551 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 09:19:47.756484 11510 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.760277 11779 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:19:47.763291 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385"
I20260620 09:19:47.763828 11293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 1 FOLLOWER]: Advancing to term 3
I20260620 09:19:47.772269 11550 raft_consensus.cc:1261] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Refusing update from remote peer e7db1005e2084c07b1c950f00bcdae65: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260620 09:19:47.772766 11550 pending_rounds.cc:76] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Aborting all ops after (but not including) 2
I20260620 09:19:47.773069 11550 pending_rounds.cc:97] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260620 09:19:47.773398 11550 raft_consensus.cc:2866] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 09:19:47.777256 11763 consensus_queue.cc:1035] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:19:47.777503 11293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 3.
I20260620 09:19:47.778745 11851 raft_consensus.cc:482] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:19:47.779121 11510 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 3 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:47.779186 11851 raft_consensus.cc:504] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.781160 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: 
I20260620 09:19:47.782975 11510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 09:19:47.783510 11510 raft_consensus.cc:686] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 LEADER]: Becoming Leader. State: Replica: f002e114dd35409482c513282aa25be7, State: Running, Role: LEADER
I20260620 09:19:47.795255 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95ff81a1269446382d58a346826f385" candidate_term: 4 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:47.806054 11851 leader_election.cc:288] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f002e114dd35409482c513282aa25be7 (127.9.154.253:34215), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:47.784286 11510 consensus_queue.cc:237] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
W20260620 09:19:47.793249 11401 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.154.254:33389, user_credentials={real_user=slave}} blocked reactor thread for 65751.5us
I20260620 09:19:47.809827 11423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95ff81a1269446382d58a346826f385" candidate_term: 4 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1" is_pre_election: true
I20260620 09:19:47.810652 11422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1"
I20260620 09:19:47.809655 11424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1" is_pre_election: true
I20260620 09:19:47.829684 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.846530 11423 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95ff81a1269446382d58a346826f385 in term 3.
I20260620 09:19:47.850394 11270 leader_election.cc:302] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, c95ff81a1269446382d58a346826f385; no voters: f002e114dd35409482c513282aa25be7
I20260620 09:19:47.851548 11293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385"
I20260620 09:19:47.852599 11293 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2eed4714a794104931a9474b72da8f1 in current term 3: Already voted for candidate f002e114dd35409482c513282aa25be7 in this term.
I20260620 09:19:47.853396 11851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 09:19:47.853899 11851 raft_consensus.cc:482] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:19:47.854743 11851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:19:47.859284 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7"
I20260620 09:19:47.864197 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 3 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:47.864334 11399 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2eed4714a794104931a9474b72da8f1; no voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7
I20260620 09:19:47.876824 11851 raft_consensus.cc:504] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.880148 11423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95ff81a1269446382d58a346826f385" candidate_term: 4 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1"
I20260620 09:19:47.880429 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95ff81a1269446382d58a346826f385" candidate_term: 4 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7"
I20260620 09:19:47.882128 11851 leader_election.cc:288] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 4 election: Requested vote from peers f002e114dd35409482c513282aa25be7 (127.9.154.253:34215), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:47.883105 11837 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 09:19:47.885779 11423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:19:47.892223 11423 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95ff81a1269446382d58a346826f385 in term 4.
I20260620 09:19:47.892437 11829 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 3 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:47.893199 11829 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:47.895401 11270 leader_election.cc:302] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, c95ff81a1269446382d58a346826f385; no voters: f002e114dd35409482c513282aa25be7
I20260620 09:19:47.896234 11851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 09:19:47.903435 11493 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 09:19:47.906594 11863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:47.910755 11851 raft_consensus.cc:686] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 LEADER]: Becoming Leader. State: Replica: c95ff81a1269446382d58a346826f385, State: Running, Role: LEADER
I20260620 09:19:47.911661 11851 consensus_queue.cc:237] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.918278 11863 catalog_manager.cc:669] Loaded metadata for table test-table [id=b3436dce7a214ad3a3c0cc674222084b]
I20260620 09:19:47.920912 11293 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 LEADER]: Rejecting Update request from peer f002e114dd35409482c513282aa25be7 for earlier term 3. Current term is 4. Ops: []
I20260620 09:19:47.921476 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95ff81a1269446382d58a346826f385. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:47.922727 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:47.925040 11829 consensus_queue.cc:1046] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 09:19:47.925843 11829 consensus_queue.cc:1225] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Peer c95ff81a1269446382d58a346826f385 log is divergent from this leader: its last log entry 4.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 09:19:47.926813 11510 raft_consensus.cc:3032] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 09:19:47.927201 11510 raft_consensus.cc:729] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f002e114dd35409482c513282aa25be7, State: Running, Role: LEADER
I20260620 09:19:47.928048 11510 consensus_queue.cc:260] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 3.11, Last appended by leader: 11, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:47.927227 11863 tablet_loader.cc:96] loaded metadata for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.929396 11510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:19:47.930820 11866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:47.933917 11863 tablet_loader.cc:96] loaded metadata for tablet 3bb66132f9704f729546842b96e39111 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.935557 11863 tablet_loader.cc:96] loaded metadata for tablet eabae62ae6d2445ab10d90110f48b994 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.937234 11863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:47.937538 11866 catalog_manager.cc:669] Loaded metadata for table test-table [id=b3436dce7a214ad3a3c0cc674222084b]
I20260620 09:19:47.942894 11863 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:47.943236 11863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:47.944100 11866 tablet_loader.cc:96] loaded metadata for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.945444 11866 tablet_loader.cc:96] loaded metadata for tablet 3bb66132f9704f729546842b96e39111 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.946856 11866 tablet_loader.cc:96] loaded metadata for tablet eabae62ae6d2445ab10d90110f48b994 (table test-table [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:47.947712 11866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:47.947996 11863 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:47.950865 11866 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:47.951128 11866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:47.951977 11863 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Loaded TSK: 0
I20260620 09:19:47.953267 11863 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:47.955837 11866 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:47.959338 11866 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Loaded TSK: 0
I20260620 09:19:47.960338 11866 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:47.995532 11358 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Refusing update from remote peer c95ff81a1269446382d58a346826f385: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 4 index: 11. (term mismatch)
I20260620 09:19:47.995855 11358 pending_rounds.cc:76] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Aborting all ops after (but not including) 10
I20260620 09:19:47.996105 11358 pending_rounds.cc:97] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Aborting uncommitted NO_OP operation due to leader change: 3.11
I20260620 09:19:47.996287 11358 raft_consensus.cc:2866] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 09:19:47.997792 11864 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 09:19:48.001411 11423 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Refusing update from remote peer c95ff81a1269446382d58a346826f385: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 4 index: 11. (index mismatch)
I20260620 09:19:48.002997 11851 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 09:19:48.002930 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95ff81a1269446382d58a346826f385. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.003793 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.007903 11851 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.008723 11851 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:48.011787 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.012917 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.019151 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95ff81a1269446382d58a346826f385. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.019891 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.020713 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.021468 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:48.024675 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c95ff81a1269446382d58a346826f385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.025332 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.090138 11735 heartbeater.cc:503] Master 127.9.154.254:33389 was elected leader, sending a full tablet report...
I20260620 09:19:48.094583 11578 heartbeater.cc:503] Master 127.9.154.254:33389 was elected leader, sending a full tablet report...
I20260620 09:19:48.096069 11281 catalog_manager.cc:5495] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:48.097847 11281 catalog_manager.cc:5495] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:48.099306 11281 catalog_manager.cc:5495] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 reported cstate change: term changed from 2 to 3, leader changed from 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194) to e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195). New cstate: current_term: 3 leader_uuid: "e7db1005e2084c07b1c950f00bcdae65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: HEALTHY } } }
I20260620 09:19:48.129335 11656 heartbeater.cc:503] Master 127.9.154.254:33389 was elected leader, sending a full tablet report...
I20260620 09:19:48.163066 11283 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42104:
table { table_id: "b3436dce7a214ad3a3c0cc674222084b" table_name: "test-table" } new_table_name: "NewTableName"
I20260620 09:19:48.189397  9835 master.cc:537] Master@127.9.154.254:33389 shutting down...
I20260620 09:19:48.257937 11886 tablet.cc:1722] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.263001 11885 tablet.cc:1722] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.265317 11887 tablet.cc:1722] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.267027 11881 tablet.cc:1722] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.268332 11880 tablet.cc:1722] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.261888 11882 tablet.cc:1722] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.273579 11888 tablet.cc:1722] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.287070 11889 tablet.cc:1722] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.280786 11884 tablet.cc:1722] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260620 09:19:48.330154  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 LEADER]: Raft consensus shutting down.
I20260620 09:19:48.331229  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:48.332248  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: stopping tablet replica
W20260620 09:19:48.364358 11379 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc540 after lost signal to thread 9838
W20260620 09:19:48.367025 11379 debug-util.cc:398] Leaking SignalData structure 0x7b0800053e60 after lost signal to thread 11382
W20260620 09:19:48.368052 11379 debug-util.cc:398] Leaking SignalData structure 0x7b0800234200 after lost signal to thread 11448
W20260620 09:19:48.369764 11379 debug-util.cc:398] Leaking SignalData structure 0x7b0800120e00 after lost signal to thread 11575
W20260620 09:19:48.370668 11379 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce2c0 after lost signal to thread 11653
W20260620 09:19:48.371642 11379 debug-util.cc:398] Leaking SignalData structure 0x7b080025e1e0 after lost signal to thread 11800
I20260620 09:19:48.383335  9835 master.cc:552] Master@127.9.154.254:33389 shutdown complete.
I20260620 09:19:48.458633 11510 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c95ff81a1269446382d58a346826f385)
I20260620 09:19:48.459161 11510 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.461077 11510 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:48.463791 11423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 5 candidate_status { last_received { term: 4 index: 13 } } ignore_live_leader: false dest_uuid: "a2eed4714a794104931a9474b72da8f1" is_pre_election: true
W20260620 09:19:48.471688 11335 leader_election.cc:334] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111)
I20260620 09:19:48.472158 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f002e114dd35409482c513282aa25be7; no voters: a2eed4714a794104931a9474b72da8f1, c95ff81a1269446382d58a346826f385
I20260620 09:19:48.472905 11510 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 09:19:48.498795 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c95ff81a1269446382d58a346826f385)
I20260620 09:19:48.499452 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.501701 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:48.502899 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 13 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:48.503507 11358 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2eed4714a794104931a9474b72da8f1 in term 4.
I20260620 09:19:48.504629 11399 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, f002e114dd35409482c513282aa25be7; no voters: 
I20260620 09:19:48.505563 11837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 09:19:48.505873 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c95ff81a1269446382d58a346826f385)
I20260620 09:19:48.506306 11837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 4 FOLLOWER]: Advancing to term 5
W20260620 09:19:48.507460 11401 leader_election.cc:334] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111)
I20260620 09:19:48.511583 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.513307 11837 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:19:48.514441 11358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 13 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7"
I20260620 09:19:48.515048 11358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 4 FOLLOWER]: Advancing to term 5
W20260620 09:19:48.516542 11401 leader_election.cc:334] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111)
I20260620 09:19:48.522264 11358 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2eed4714a794104931a9474b72da8f1 in term 5.
I20260620 09:19:48.523437 11399 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2eed4714a794104931a9474b72da8f1, f002e114dd35409482c513282aa25be7; no voters: c95ff81a1269446382d58a346826f385
I20260620 09:19:48.524210 11837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 09:19:48.525971 11837 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 LEADER]: Becoming Leader. State: Replica: a2eed4714a794104931a9474b72da8f1, State: Running, Role: LEADER
I20260620 09:19:48.526916 11837 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 4.13, Last appended by leader: 13, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.530735 11897 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2eed4714a794104931a9474b72da8f1. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.531410 11897 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:48.533010 11898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:19:48.539038 11898 catalog_manager.cc:669] Loaded metadata for table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b]
I20260620 09:19:48.545295 11898 tablet_loader.cc:96] loaded metadata for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:48.546805 11898 tablet_loader.cc:96] loaded metadata for tablet 3bb66132f9704f729546842b96e39111 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:48.548336 11898 tablet_loader.cc:96] loaded metadata for tablet eabae62ae6d2445ab10d90110f48b994 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:48.549827 11898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:19:48.554955 11898 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:48.555218 11898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:19:48.561054 11898 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:48.565653 11898 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Loaded TSK: 0
I20260620 09:19:48.566622 11898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:48.597031  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:19:48.604391 11899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:48.604744 11900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:19:48.610881 11401 consensus_peers.cc:487] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 -> Peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Couldn't send request to peer c95ff81a1269446382d58a346826f385. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 09:19:48.611704 11902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:48.612650  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:48.613628  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:19:48.613946  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:48.614135  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947188614118 us; error 0 us; skew 500 ppm
I20260620 09:19:48.614861  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:48.618185  9835 webserver.cc:460] Webserver started at http://127.9.154.254:38623/ using document root <none> and password file <none>
I20260620 09:19:48.618904  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:48.620637  9835 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 09:19:48.625448 11358 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Refusing update from remote peer a2eed4714a794104931a9474b72da8f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 13. Preceding OpId from leader: term: 5 index: 14. (index mismatch)
I20260620 09:19:48.627147 11897 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260620 09:19:48.629537  9835 fs_manager.cc:709] Time spent opening directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260620 09:19:48.632009 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2eed4714a794104931a9474b72da8f1. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.632900 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.639765 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.640755 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.643325 11907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:48.644093 11908 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.644706 11908 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:48.687084 11654 heartbeater.cc:503] Master 127.9.154.252:38359 was elected leader, sending a full tablet report...
I20260620 09:19:48.702759  9835 fs_manager.cc:725] Time spent opening block manager: real 0.071s	user 0.006s	sys 0.001s
I20260620 09:19:48.705940  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "c95ff81a1269446382d58a346826f385"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:48.706804  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:48.746544 11732 heartbeater.cc:503] Master 127.9.154.252:38359 was elected leader, sending a full tablet report...
I20260620 09:19:48.760344  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:48.762774  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:19:48.780191 11414 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: NewTableName [id=b3436dce7a214ad3a3c0cc674222084b] alter complete (version 1)
I20260620 09:19:48.828729 11576 heartbeater.cc:503] Master 127.9.154.252:38359 was elected leader, sending a full tablet report...
I20260620 09:19:48.852615  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:33389
I20260620 09:19:48.856302 11962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:33389 every 8 connection(s)
I20260620 09:19:48.871856 11963 sys_catalog.cc:263] Verifying existing consensus state
I20260620 09:19:48.883406 11735 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:48.884438 11963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Bootstrap starting.
I20260620 09:19:48.941007 11656 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:48.947348 11578 heartbeater.cc:347] Connected to a master server at 127.9.154.254:33389
I20260620 09:19:48.961267 11963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=7 ignored=0} mutations{seen=11 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:19:48.962525 11963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: Bootstrap complete.
I20260620 09:19:48.965471 11963 raft_consensus.cc:348] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.966183 11963 raft_consensus.cc:729] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95ff81a1269446382d58a346826f385, State: Initialized, Role: FOLLOWER
I20260620 09:19:48.966981 11963 consensus_queue.cc:260] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 4.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:48.969231 11968 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:48.970408 11968 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:48.974431 11963 sys_catalog.cc:564] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:48.975055 11938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 4 FOLLOWER]: Advancing to term 5
I20260620 09:19:49.039296  9835 master.cc:537] Master@127.9.154.252:38359 shutting down...
I20260620 09:19:49.128485 11983 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 09:19:49.138203 11968 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2eed4714a794104931a9474b72da8f1. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.139142 11968 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.143919 11980 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "a2eed4714a794104931a9474b72da8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.150022 11980 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.152163 11928 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" instance_seqno: 1781947184720211) as {username='slave'} at 127.0.0.1:42368; Asking this server to re-register.
I20260620 09:19:49.154498 11735 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.159456 11928 ts_manager.cc:194] Registered new tserver with Master: e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:49.162348  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 LEADER]: Raft consensus shutting down.
I20260620 09:19:49.163739  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 09:19:49.164297  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: stopping tablet replica
I20260620 09:19:49.190536  9835 master.cc:552] Master@127.9.154.252:38359 shutdown complete.
I20260620 09:19:49.194470 11980 raft_consensus.cc:482] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2eed4714a794104931a9474b72da8f1)
I20260620 09:19:49.195170 11980 raft_consensus.cc:504] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.208976 11980 leader_election.cc:288] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f002e114dd35409482c513282aa25be7 (127.9.154.253:34215), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
W20260620 09:19:49.210027 11913 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111) [suppressed 17 similar messages]
W20260620 09:19:49.215886 11913 leader_election.cc:334] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359): Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
I20260620 09:19:49.219767 11928 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "369e0e637f7b495d954f88956390d6eb" instance_seqno: 1781947184362261) as {username='slave'} at 127.0.0.1:42388; Asking this server to re-register.
I20260620 09:19:49.222110 11578 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.227016 11928 ts_manager.cc:194] Registered new tserver with Master: 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211)
I20260620 09:19:49.231863 11357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95ff81a1269446382d58a346826f385" candidate_term: 6 candidate_status { last_received { term: 5 index: 15 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:19:49.234946 11911 leader_election.cc:302] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95ff81a1269446382d58a346826f385; no voters: a2eed4714a794104931a9474b72da8f1, f002e114dd35409482c513282aa25be7
I20260620 09:19:49.236277 11980 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 09:19:49.236372 11928 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" instance_seqno: 1781947184536533) as {username='slave'} at 127.0.0.1:42380; Asking this server to re-register.
I20260620 09:19:49.238214 11656 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.242654 11928 ts_manager.cc:194] Registered new tserver with Master: 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:49.363961 11988 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2eed4714a794104931a9474b72da8f1)
I20260620 09:19:49.364462 11988 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.366590 11988 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
W20260620 09:19:49.375445 11335 leader_election.cc:334] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359): Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
I20260620 09:19:49.381457 11938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 6 candidate_status { last_received { term: 5 index: 15 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:19:49.382170 11938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 5.
I20260620 09:19:49.383165 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: a2eed4714a794104931a9474b72da8f1
I20260620 09:19:49.383908 11988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 09:19:49.384294 11988 raft_consensus.cc:482] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2eed4714a794104931a9474b72da8f1)
I20260620 09:19:49.384603 11988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 5 FOLLOWER]: Advancing to term 6
I20260620 09:19:49.391307 11988 raft_consensus.cc:504] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.393322 11988 leader_election.cc:288] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 election: Requested vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359)
I20260620 09:19:49.396097 11938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f002e114dd35409482c513282aa25be7" candidate_term: 6 candidate_status { last_received { term: 5 index: 15 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385"
I20260620 09:19:49.396791 11938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 5 FOLLOWER]: Advancing to term 6
I20260620 09:19:49.403106 11938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f002e114dd35409482c513282aa25be7 in term 6.
W20260620 09:19:49.404160 11335 leader_election.cc:334] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359): Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111)
I20260620 09:19:49.404997 11335 leader_election.cc:302] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7; no voters: a2eed4714a794104931a9474b72da8f1
I20260620 09:19:49.405686 11988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 09:19:49.406710 11988 raft_consensus.cc:686] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 LEADER]: Becoming Leader. State: Replica: f002e114dd35409482c513282aa25be7, State: Running, Role: LEADER
I20260620 09:19:49.407625 11988 consensus_queue.cc:237] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 5.15, Last appended by leader: 15, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.410887 11992 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.412264 11992 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:49.415428  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:19:49.415539 11993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260620 09:19:49.423676 11994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:49.424582 11993 catalog_manager.cc:669] Loaded metadata for table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b]
W20260620 09:19:49.430671 11995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:49.433791 11993 tablet_loader.cc:96] loaded metadata for tablet 2ff0f6d8ef6f4414b77ace9e88d74d13 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:49.436156 11993 tablet_loader.cc:96] loaded metadata for tablet 3bb66132f9704f729546842b96e39111 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:49.438094 11993 tablet_loader.cc:96] loaded metadata for tablet eabae62ae6d2445ab10d90110f48b994 (table NewTableName [id=b3436dce7a214ad3a3c0cc674222084b])
I20260620 09:19:49.440011 11993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260620 09:19:49.442443 11997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:19:49.444505  9835 server_base.cc:1034] running on GCE node
I20260620 09:19:49.446249 11993 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:49.446283  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260620 09:19:49.446738 11993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
W20260620 09:19:49.446748  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:19:49.447317  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947189447299 us; error 0 us; skew 500 ppm
I20260620 09:19:49.450611  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:19:49.454661 11993 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:19:49.461298 11993 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: Loaded TSK: 0
I20260620 09:19:49.462759 11993 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:19:49.463878  9835 webserver.cc:460] Webserver started at http://127.9.154.252:46675/ using document root <none> and password file <none>
I20260620 09:19:49.464583  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:19:49.464834  9835 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 09:19:49.477496  9835 fs_manager.cc:709] Time spent opening directory manager: real 0.011s	user 0.003s	sys 0.008s
I20260620 09:19:49.481153 12002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:19:49.482034  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260620 09:19:49.482412  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
uuid: "a2eed4714a794104931a9474b72da8f1"
format_stamp: "Formatted at 2026-06-20 09:19:43 on dist-test-slave-zmgx"
I20260620 09:19:49.482744  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:19:49.496788  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:19:49.498427  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260620 09:19:49.502331 11335 consensus_peers.cc:487] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 -> Peer a2eed4714a794104931a9474b72da8f1 (127.9.154.252:38359): Couldn't send request to peer a2eed4714a794104931a9474b72da8f1. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.252:38359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:19:49.514317 11938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Refusing update from remote peer f002e114dd35409482c513282aa25be7: Log matching property violated. Preceding OpId in replica: term: 5 index: 15. Preceding OpId from leader: term: 6 index: 16. (index mismatch)
I20260620 09:19:49.516552 11992 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260620 09:19:49.523175 11980 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.524267 11980 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.530727 11980 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.531875 11980 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.543480 11992 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.545481 11992 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:49.618888  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.252:38359
I20260620 09:19:49.619028 12055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.252:38359 every 8 connection(s)
I20260620 09:19:49.629491 12056 sys_catalog.cc:263] Verifying existing consensus state
I20260620 09:19:49.636643 12056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Bootstrap starting.
I20260620 09:19:49.653038 11577 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:49.668781 11654 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
I20260620 09:19:49.672390 11733 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:49.669622 11655 heartbeater.cc:503] Master 127.9.154.253:34215 was elected leader, sending a full tablet report...
I20260620 09:19:49.702525 12056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=7 ignored=0} mutations{seen=12 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:19:49.703580 12056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: Bootstrap complete.
I20260620 09:19:49.707253 12056 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.707721 11732 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
I20260620 09:19:49.708050 12056 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2eed4714a794104931a9474b72da8f1, State: Initialized, Role: FOLLOWER
I20260620 09:19:49.708810 12056 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 5.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:19:49.761787 11576 heartbeater.cc:347] Connected to a master server at 127.9.154.252:38359
I20260620 09:19:49.763069 12056 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:19:49.763468 12031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 5 FOLLOWER]: Advancing to term 6
I20260620 09:19:49.761718 12061 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.772576 12061 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.779928 12064 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.780949 12064 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.780794 12061 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f002e114dd35409482c513282aa25be7. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.781708 12061 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 09:19:49.798527 12076 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:49.798908 12076 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: loading cluster ID for follower catalog manager: success
I20260620 09:19:49.804467 12076 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: acquiring CA information for follower catalog manager: success
I20260620 09:19:49.809338 12076 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 09:19:49.847295 12021 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" instance_seqno: 1781947184720211) as {username='slave'} at 127.0.0.1:37930; Asking this server to re-register.
I20260620 09:19:49.847436 11992 sys_catalog.cc:455] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "f002e114dd35409482c513282aa25be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } } }
I20260620 09:19:49.848224 11992 sys_catalog.cc:458] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [sys.catalog]: This master's current role is: LEADER
I20260620 09:19:49.849318 11732 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.857605 12021 ts_manager.cc:194] Registered new tserver with Master: e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:19:49.864518 12021 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" instance_seqno: 1781947184536533) as {username='slave'} at 127.0.0.1:37926; Asking this server to re-register.
I20260620 09:19:49.865836 11654 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.869272 12021 ts_manager.cc:194] Registered new tserver with Master: 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:19:49.873549 12021 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "369e0e637f7b495d954f88956390d6eb" instance_seqno: 1781947184362261) as {username='slave'} at 127.0.0.1:37946; Asking this server to re-register.
I20260620 09:19:49.874794 11576 heartbeater.cc:464] Registering TS with master...
I20260620 09:19:49.878085 12021 ts_manager.cc:194] Registered new tserver with Master: 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211)
I20260620 09:19:50.132913 11983 catalog_manager.cc:1259] Loaded cluster ID: 8877b29214224edbb834141cc0b74ebf
I20260620 09:19:50.133224 11983 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: loading cluster ID for follower catalog manager: success
I20260620 09:19:50.139192 11983 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: acquiring CA information for follower catalog manager: success
I20260620 09:19:50.142836 11983 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 09:20:12.677764 12105 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:12.679363 12105 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:12.682735 12105 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:12.702270 12106 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f002e114dd35409482c513282aa25be7)
I20260620 09:20:12.702811 12106 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ff81a1269446382d58a346826f385" member_type: VOTER last_known_addr { host: "127.9.154.254" port: 33389 } } peers { permanent_uuid: "f002e114dd35409482c513282aa25be7" member_type: VOTER last_known_addr { host: "127.9.154.253" port: 34215 } } peers { permanent_uuid: "a2eed4714a794104931a9474b72da8f1" member_type: VOTER last_known_addr { host: "127.9.154.252" port: 38359 } }
I20260620 09:20:12.706688 12106 leader_election.cc:288] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c95ff81a1269446382d58a346826f385 (127.9.154.254:33389), f002e114dd35409482c513282aa25be7 (127.9.154.253:34215)
I20260620 09:20:12.730271 12105 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:12.730897 12105 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:12.733117 12105 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:12.743865 12105 raft_consensus.cc:482] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:12.744457 12105 raft_consensus.cc:504] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } }
I20260620 09:20:12.747128 12105 leader_election.cc:288] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:12.753652 12107 raft_consensus.cc:482] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:12.754192 12107 raft_consensus.cc:504] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:12.756875 12107 leader_election.cc:288] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:12.765828 11704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:12.767083 11628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:20:12.771201 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:12.790098 11550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:20:12.790844 11550 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 3.
I20260620 09:20:12.791306 11548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:20:12.792241 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:12.792742 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:12.791261 11549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ff0f6d8ef6f4414b77ace9e88d74d13" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:20:12.793497 12105 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 09:20:12.793687 11514 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:12.793882 12105 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:12.794569 12105 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:20:12.794708 12107 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 09:20:12.795403 11592 leader_election.cc:302] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:12.800660 12109 raft_consensus.cc:2726] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 09:20:12.806147 12105 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:12.809186 12105 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:12.810665 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:20:12.812712 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eabae62ae6d2445ab10d90110f48b994" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:12.815644 11626 raft_consensus.cc:1226] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Rejecting Update request from peer e7db1005e2084c07b1c950f00bcdae65 for earlier term 3. Current term is 4. Ops: []
I20260620 09:20:12.817754 12103 consensus_queue.cc:1046] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 09:20:12.818830 12103 raft_consensus.cc:3032] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 09:20:12.821213 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:20:12.822253 12103 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e7db1005e2084c07b1c950f00bcdae65, State: Running, Role: LEADER
I20260620 09:20:12.823288 12103 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:12.824602 12103 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:20:12.819595 11592 leader_election.cc:302] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:12.827060 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:12.827838 12109 raft_consensus.cc:2726] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 09:20:12.828158 12105 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 09:20:12.833269 11357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 16 } } ignore_live_leader: false dest_uuid: "f002e114dd35409482c513282aa25be7" is_pre_election: true
I20260620 09:20:12.842530 11938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2eed4714a794104931a9474b72da8f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 16 } } ignore_live_leader: false dest_uuid: "c95ff81a1269446382d58a346826f385" is_pre_election: true
I20260620 09:20:12.843766 12006 leader_election.cc:302] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2eed4714a794104931a9474b72da8f1; no voters: c95ff81a1269446382d58a346826f385, f002e114dd35409482c513282aa25be7
I20260620 09:20:12.844360 12106 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 09:20:13.007290 12107 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:13.007732 12107 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.009431 12107 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.010025 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:20:13.010656 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:13.011159 11626 raft_consensus.cc:2379] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 4: Already voted for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in this term.
I20260620 09:20:13.011488 11705 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 4.
I20260620 09:20:13.012473 11514 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77
I20260620 09:20:13.013168 12107 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 09:20:13.013465 12107 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e7db1005e2084c07b1c950f00bcdae65)
I20260620 09:20:13.013792 12107 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Advancing to term 4
I20260620 09:20:13.018883 12107 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.020239 12107 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 election: Requested vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.021054 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:20:13.021167 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:20:13.021641 11626 raft_consensus.cc:2379] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 369e0e637f7b495d954f88956390d6eb in current term 4: Already voted for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in this term.
I20260620 09:20:13.026456 11705 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 4.
I20260620 09:20:13.027410 11514 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65; no voters: 89fdaefc8a1b44e4b64fc41474ee4d77
I20260620 09:20:13.028066 12107 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 FOLLOWER]: Leader election won for term 4
I20260620 09:20:13.029515 12107 raft_consensus.cc:686] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 LEADER]: Becoming Leader. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Running, Role: LEADER
I20260620 09:20:13.031093 12107 consensus_queue.cc:237] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.044641 11347 catalog_manager.cc:5495] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb reported cstate change: term changed from 3 to 4, leader changed from e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195) to 369e0e637f7b495d954f88956390d6eb (127.9.154.193). New cstate: current_term: 4 leader_uuid: "369e0e637f7b495d954f88956390d6eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: UNKNOWN } } }
I20260620 09:20:13.124676 12105 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:13.125241 12105 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.126243 11626 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Refusing update from remote peer 369e0e637f7b495d954f88956390d6eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 09:20:13.126929 12105 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.127691 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:20:13.127583 12107 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 09:20:13.127938 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:13.128525 11705 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in term 4.
I20260620 09:20:13.129439 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77, e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb
I20260620 09:20:13.131592 12109 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 09:20:13.137444 12109 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 369e0e637f7b495d954f88956390d6eb)
I20260620 09:20:13.137902 12109 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 4 FOLLOWER]: Advancing to term 5
I20260620 09:20:13.150687 11705 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Refusing update from remote peer 369e0e637f7b495d954f88956390d6eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 09:20:13.154662 12109 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.156221 11626 raft_consensus.cc:1226] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Rejecting Update request from peer 369e0e637f7b495d954f88956390d6eb for earlier term 4. Current term is 5. Ops: []
I20260620 09:20:13.157080 12107 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 09:20:13.158061 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb"
I20260620 09:20:13.160210 11706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:20:13.161743 11592 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 369e0e637f7b495d954f88956390d6eb, e7db1005e2084c07b1c950f00bcdae65
I20260620 09:20:13.162725 12105 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 09:20:13.161319 12128 consensus_queue.cc:1046] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260620 09:20:13.164181 12107 raft_consensus.cc:3032] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 LEADER]: Stepping down as leader of term 4
I20260620 09:20:13.164561 12107 raft_consensus.cc:729] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Running, Role: LEADER
I20260620 09:20:13.165580 12107 consensus_queue.cc:260] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.166898 12107 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 4 FOLLOWER]: Advancing to term 5
I20260620 09:20:13.158804 12109 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [CANDIDATE]: Term 5 election: Requested vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.352073 12107 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:13.352525 12107 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.355032 12107 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.355094 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:20:13.355769 11626 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 5.
I20260620 09:20:13.356236 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65" is_pre_election: true
I20260620 09:20:13.357127 11516 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 
I20260620 09:20:13.358006 12107 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 09:20:13.358551 12107 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:20:13.358909 12107 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 5 FOLLOWER]: Advancing to term 6
I20260620 09:20:13.361335 12103 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 369e0e637f7b495d954f88956390d6eb)
I20260620 09:20:13.361970 12103 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.364821 12103 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:20:13.365021 11551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "369e0e637f7b495d954f88956390d6eb" is_pre_election: true
I20260620 09:20:13.365693 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "e7db1005e2084c07b1c950f00bcdae65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" is_pre_election: true
I20260620 09:20:13.366293 11626 raft_consensus.cc:2379] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7db1005e2084c07b1c950f00bcdae65 in current term 5: Already voted for candidate 89fdaefc8a1b44e4b64fc41474ee4d77 in this term.
I20260620 09:20:13.366426 12107 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.367483 11551 raft_consensus.cc:2354] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7db1005e2084c07b1c950f00bcdae65 for earlier term 5. Current term is 6.
I20260620 09:20:13.368860 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77"
I20260620 09:20:13.369130 12107 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 6 election: Requested vote from peers 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385), e7db1005e2084c07b1c950f00bcdae65 (127.9.154.195:44545)
I20260620 09:20:13.369366 11705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bb66132f9704f729546842b96e39111" candidate_uuid: "369e0e637f7b495d954f88956390d6eb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e7db1005e2084c07b1c950f00bcdae65"
I20260620 09:20:13.369335 11626 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 5 FOLLOWER]: Advancing to term 6
I20260620 09:20:13.370012 11705 raft_consensus.cc:3037] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 4 FOLLOWER]: Advancing to term 6
I20260620 09:20:13.370285 11670 leader_election.cc:398] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211) with higher term. Message: Invalid argument: T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7db1005e2084c07b1c950f00bcdae65 for earlier term 5. Current term is 6.
I20260620 09:20:13.370532 11670 leader_election.cc:401] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260620 09:20:13.376199 11626 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 6.
I20260620 09:20:13.376199 11705 raft_consensus.cc:2454] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369e0e637f7b495d954f88956390d6eb in term 6.
I20260620 09:20:13.377223 12103 raft_consensus.cc:2726] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211) with higher term. Message: Invalid argument: T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7db1005e2084c07b1c950f00bcdae65 for earlier term 5. Current term is 6.
I20260620 09:20:13.377575 11516 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77; no voters: 
I20260620 09:20:13.378553 12107 raft_consensus.cc:2781] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Leader election won for term 6
I20260620 09:20:13.379025 12107 raft_consensus.cc:686] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 LEADER]: Becoming Leader. State: Replica: 369e0e637f7b495d954f88956390d6eb, State: Running, Role: LEADER
I20260620 09:20:13.379762 12107 consensus_queue.cc:237] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:13.388151 11347 catalog_manager.cc:5495] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "369e0e637f7b495d954f88956390d6eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } health_report { overall_health: UNKNOWN } } }
I20260620 09:20:13.471849 11626 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Refusing update from remote peer 369e0e637f7b495d954f88956390d6eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 09:20:13.473114 12107 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 09:20:13.491393 11705 raft_consensus.cc:1261] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Refusing update from remote peer 369e0e637f7b495d954f88956390d6eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 09:20:13.496821 12107 consensus_queue.cc:1035] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260620 09:20:13.785380 12052 debug-util.cc:398] Leaking SignalData structure 0x7b0800141380 after lost signal to thread 9838
W20260620 09:20:13.787345 12052 debug-util.cc:398] Leaking SignalData structure 0x7b0800259b40 after lost signal to thread 11575
W20260620 09:20:13.788264 12052 debug-util.cc:398] Leaking SignalData structure 0x7b0800247c60 after lost signal to thread 11653
W20260620 09:20:13.789201 12052 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7600 after lost signal to thread 11731
W20260620 09:20:13.790542 12052 debug-util.cc:398] Leaking SignalData structure 0x7b0800259be0 after lost signal to thread 12055
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:783: Failure
Expected equality of these values:
  live_row_count
    Which is: 802
  table_info->GetMetrics()->live_row_count->value()
    Which is: 1604
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:767: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:785: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 782, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:895: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20260620 09:20:19.882155  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
W20260620 09:20:19.911212 11670 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260620 09:20:19.917912 11670 consensus_peers.cc:487] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Couldn't send request to peer 369e0e637f7b495d954f88956390d6eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:19.919376  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:19.920326  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.921523  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:19.922171  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.924896  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.925359  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:19.925797  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 369e0e637f7b495d954f88956390d6eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.929149  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb: stopping tablet replica
I20260620 09:20:19.929740  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 LEADER]: Raft consensus shutting down.
I20260620 09:20:19.930718  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P 369e0e637f7b495d954f88956390d6eb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:19.955004  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
W20260620 09:20:19.965183 11670 consensus_peers.cc:487] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Couldn't send request to peer 369e0e637f7b495d954f88956390d6eb. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.193:44211: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:19.975270  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
W20260620 09:20:20.003033 11672 consensus_peers.cc:487] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Couldn't send request to peer 89fdaefc8a1b44e4b64fc41474ee4d77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.019721  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:20.020460  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.021179  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.021766  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.024593  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.025058  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.025461  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.027881  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77: stopping tablet replica
I20260620 09:20:20.028414  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.028973  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P 89fdaefc8a1b44e4b64fc41474ee4d77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.060582  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
W20260620 09:20:20.061102 11672 consensus_peers.cc:487] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 -> Peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Couldn't send request to peer 89fdaefc8a1b44e4b64fc41474ee4d77. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.194:35385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.075412  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:20:20.107636 12138 raft_consensus.cc:482] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 369e0e637f7b495d954f88956390d6eb)
I20260620 09:20:20.108282 12138 raft_consensus.cc:504] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369e0e637f7b495d954f88956390d6eb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 44211 } } peers { permanent_uuid: "89fdaefc8a1b44e4b64fc41474ee4d77" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 35385 } } peers { permanent_uuid: "e7db1005e2084c07b1c950f00bcdae65" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 44545 } }
I20260620 09:20:20.110330 12138 leader_election.cc:288] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211), 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385)
I20260620 09:20:20.112270  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:20.113301  9835 tablet_replica.cc:330] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.114212  9835 raft_consensus.cc:2229] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.114916  9835 raft_consensus.cc:2258] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260620 09:20:20.115085 11670 leader_election.cc:334] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 369e0e637f7b495d954f88956390d6eb (127.9.154.193:44211): Network error: Client connection negotiation failed: client connection to 127.9.154.193:44211: connect: Connection refused (error 111)
W20260620 09:20:20.115862 11672 leader_election.cc:334] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 89fdaefc8a1b44e4b64fc41474ee4d77 (127.9.154.194:35385): Network error: Client connection negotiation failed: client connection to 127.9.154.194:35385: connect: Connection refused (error 111)
I20260620 09:20:20.116196 11672 leader_election.cc:302] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7db1005e2084c07b1c950f00bcdae65; no voters: 369e0e637f7b495d954f88956390d6eb, 89fdaefc8a1b44e4b64fc41474ee4d77
W20260620 09:20:20.116703 11672 raft_consensus.cc:2670] T 3bb66132f9704f729546842b96e39111 P e7db1005e2084c07b1c950f00bcdae65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 09:20:20.118644  9835 tablet_replica.cc:330] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.119321  9835 raft_consensus.cc:2229] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.120283  9835 raft_consensus.cc:2258] T 2ff0f6d8ef6f4414b77ace9e88d74d13 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.122907  9835 tablet_replica.cc:330] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65: stopping tablet replica
I20260620 09:20:20.123364  9835 raft_consensus.cc:2229] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.124200  9835 raft_consensus.cc:2258] T eabae62ae6d2445ab10d90110f48b994 P e7db1005e2084c07b1c950f00bcdae65 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.147790  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:20:20.165396  9835 master.cc:537] Master@127.9.154.254:33389 shutting down...
I20260620 09:20:20.192739  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.193344  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c95ff81a1269446382d58a346826f385 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.193725  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:20.212769  9835 master.cc:552] Master@127.9.154.254:33389 shutdown complete.
I20260620 09:20:20.232159  9835 master.cc:537] Master@127.9.154.253:34215 shutting down...
W20260620 09:20:20.249900 11335 consensus_peers.cc:487] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 -> Peer c95ff81a1269446382d58a346826f385 (127.9.154.254:33389): Couldn't send request to peer c95ff81a1269446382d58a346826f385. Status: Network error: Client connection negotiation failed: client connection to 127.9.154.254:33389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:20.257858  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 LEADER]: Raft consensus shutting down.
I20260620 09:20:20.258818  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.259150  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P f002e114dd35409482c513282aa25be7: stopping tablet replica
I20260620 09:20:20.305516  9835 master.cc:552] Master@127.9.154.253:34215 shutdown complete.
I20260620 09:20:20.326793  9835 master.cc:537] Master@127.9.154.252:38359 shutting down...
I20260620 09:20:20.347808  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:20.348366  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a2eed4714a794104931a9474b72da8f1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:20.348676  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:20.385092  9835 master.cc:552] Master@127.9.154.252:38359 shutdown complete.
I20260620 09:20:20.411586  9835 test_util.cc:175] -----------------------------------------------
I20260620 09:20:20.411800  9835 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1781947168426282-9835-0
[  FAILED  ] TsTabletManagerITest.TestTableStats (36615 ms)
[ RUN      ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260620 09:20:20.418453  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:46735
I20260620 09:20:20.419745  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:20.426195 12154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.426633 12155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.428341 12157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:20.430510  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:20.432611  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:20.432811  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:20.432933  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947220432924 us; error 0 us; skew 500 ppm
I20260620 09:20:20.433398  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:20.439580  9835 webserver.cc:460] Webserver started at http://127.9.154.254:34225/ using document root <none> and password file <none>
I20260620 09:20:20.440069  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:20.440248  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:20.440481  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:20.441746  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "1988fdffc6e54a81bfe848228d65e545"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.446503  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:20:20.449976 12162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.450800  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 09:20:20.451077  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "1988fdffc6e54a81bfe848228d65e545"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.451361  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:20.462044  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:20.463376  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:20.503363  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:46735
I20260620 09:20:20.503545 12213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:46735 every 8 connection(s)
I20260620 09:20:20.507264 12214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:20.517859 12214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: Bootstrap starting.
I20260620 09:20:20.522773 12214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:20.527621 12214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: No bootstrap required, opened a new log
I20260620 09:20:20.529778 12214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER }
I20260620 09:20:20.530208 12214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:20.530505 12214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1988fdffc6e54a81bfe848228d65e545, State: Initialized, Role: FOLLOWER
I20260620 09:20:20.531106 12214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER }
I20260620 09:20:20.531605 12214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:20.531828 12214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:20.532151 12214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:20.536521 12214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER }
I20260620 09:20:20.537043 12214 leader_election.cc:302] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1988fdffc6e54a81bfe848228d65e545; no voters: 
I20260620 09:20:20.538187 12214 leader_election.cc:288] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:20.538666 12217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:20.539947 12217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 1 LEADER]: Becoming Leader. State: Replica: 1988fdffc6e54a81bfe848228d65e545, State: Running, Role: LEADER
I20260620 09:20:20.540625 12217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER }
I20260620 09:20:20.541446 12214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:20.545069 12218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1988fdffc6e54a81bfe848228d65e545" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER } }
I20260620 09:20:20.545740 12218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:20.545768 12219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1988fdffc6e54a81bfe848228d65e545. Latest consensus state: current_term: 1 leader_uuid: "1988fdffc6e54a81bfe848228d65e545" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1988fdffc6e54a81bfe848228d65e545" member_type: VOTER } }
I20260620 09:20:20.546469 12219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:20.548261 12224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:20.553339 12224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:20.558032  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:20.562386 12224 catalog_manager.cc:1347] Generated new cluster ID: ee39fc3b6798405d96799d93a0cbb1e4
I20260620 09:20:20.562738 12224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:20.574846 12224 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:20.576717 12224 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:20.591622 12224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: Generated new TSK 0
I20260620 09:20:20.592288 12224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:20.625567  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:20.631729 12235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.632659 12236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.634114 12238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:20.635030  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:20.635957  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:20.636197  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:20.636368  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947220636356 us; error 0 us; skew 500 ppm
I20260620 09:20:20.636914  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:20.639144  9835 webserver.cc:460] Webserver started at http://127.9.154.193:43195/ using document root <none> and password file <none>
I20260620 09:20:20.639603  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:20.639789  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:20.640087  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:20.641136  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "ba02182353974e39b108fc9154ca01ea"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.645651  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260620 09:20:20.648881 12243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.649597  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:20:20.649879  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "ba02182353974e39b108fc9154ca01ea"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.650125  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:20.681479  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:20.682747  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:20.684058  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:20.686314  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:20.686491  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.686759  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:20.686910  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.728878  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:41767
I20260620 09:20:20.728978 12305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:41767 every 8 connection(s)
I20260620 09:20:20.733826  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:20.742574 12310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.744225 12311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:20.746012  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:20.746696 12314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:20.747627  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:20.747892  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:20.748111 12306 heartbeater.cc:347] Connected to a master server at 127.9.154.254:46735
I20260620 09:20:20.748090  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947220748073 us; error 0 us; skew 500 ppm
I20260620 09:20:20.748647 12306 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:20.749121  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:20.749471 12306 heartbeater.cc:511] Master 127.9.154.254:46735 requested a full tablet report, sending...
I20260620 09:20:20.751801 12179 ts_manager.cc:194] Registered new tserver with Master: ba02182353974e39b108fc9154ca01ea (127.9.154.193:41767)
I20260620 09:20:20.752506  9835 webserver.cc:460] Webserver started at http://127.9.154.194:37687/ using document root <none> and password file <none>
I20260620 09:20:20.753119  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:20.753338  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:20.753645  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:20.753998 12179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35012
I20260620 09:20:20.754866  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "108240cb607f446fb35dceaa2c0d5829"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.759466  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:20:20.763722 12318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.764699  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260620 09:20:20.764932  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "108240cb607f446fb35dceaa2c0d5829"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.765166  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:20.794513  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:20.795742  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:20.797369  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:20.799832  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:20.800019  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.800324  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:20.800472  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.847393  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:45159
I20260620 09:20:20.847550 12380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:45159 every 8 connection(s)
I20260620 09:20:20.852329  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:20.859567 12384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.860200 12385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:20.864818 12387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:20.864863  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:20.866207  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:20.866498  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:20.866695  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947220866678 us; error 0 us; skew 500 ppm
I20260620 09:20:20.867239  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:20.868139 12381 heartbeater.cc:347] Connected to a master server at 127.9.154.254:46735
I20260620 09:20:20.868589 12381 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:20.869372 12381 heartbeater.cc:511] Master 127.9.154.254:46735 requested a full tablet report, sending...
I20260620 09:20:20.870028  9835 webserver.cc:460] Webserver started at http://127.9.154.195:45305/ using document root <none> and password file <none>
I20260620 09:20:20.870599  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:20.870749  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:20.870930  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:20.871591 12179 ts_manager.cc:194] Registered new tserver with Master: 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159)
I20260620 09:20:20.871956  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root/instance:
uuid: "5732e678a44a4230ab954a5a4c3a5b50"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.873317 12179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35014
I20260620 09:20:20.876547  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:20:20.880156 12392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.880921  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260620 09:20:20.881218  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root
uuid: "5732e678a44a4230ab954a5a4c3a5b50"
format_stamp: "Formatted at 2026-06-20 09:20:20 on dist-test-slave-zmgx"
I20260620 09:20:20.881456  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:20.895788  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:20.896914  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:20.899094  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:20.901809  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:20.902079  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.902376  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:20.902554  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:20.946661  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.195:40375
I20260620 09:20:20.946759 12454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.195:40375 every 8 connection(s)
I20260620 09:20:20.967999 12455 heartbeater.cc:347] Connected to a master server at 127.9.154.254:46735
I20260620 09:20:20.968401 12455 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:20.969331 12455 heartbeater.cc:511] Master 127.9.154.254:46735 requested a full tablet report, sending...
I20260620 09:20:20.971426 12179 ts_manager.cc:194] Registered new tserver with Master: 5732e678a44a4230ab954a5a4c3a5b50 (127.9.154.195:40375)
I20260620 09:20:20.972478  9835 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022775717s
I20260620 09:20:20.972981 12179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35024
I20260620 09:20:21.010766 12179 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35030:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
  }
}
W20260620 09:20:21.012463 12179 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 09:20:21.063300 12271 tablet_service.cc:1467] Processing CreateTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c (DEFAULT_TABLE table=test-table [id=fa28f0155467438a99af3d0556e9c9ff]), partition=
I20260620 09:20:21.064307 12271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d57bcb38f4382af4e732fa2a6b26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:21.074366 12346 tablet_service.cc:1467] Processing CreateTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c (DEFAULT_TABLE table=test-table [id=fa28f0155467438a99af3d0556e9c9ff]), partition=
I20260620 09:20:21.075416 12346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d57bcb38f4382af4e732fa2a6b26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:21.080283 12471 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Bootstrap starting.
I20260620 09:20:21.080164 12420 tablet_service.cc:1467] Processing CreateTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c (DEFAULT_TABLE table=test-table [id=fa28f0155467438a99af3d0556e9c9ff]), partition=
I20260620 09:20:21.081321 12420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d57bcb38f4382af4e732fa2a6b26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:21.087261 12471 tablet_bootstrap.cc:654] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:21.093070 12471 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: No bootstrap required, opened a new log
I20260620 09:20:21.093523 12471 ts_tablet_manager.cc:1397] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260620 09:20:21.094861 12472 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Bootstrap starting.
I20260620 09:20:21.096160 12471 raft_consensus.cc:348] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.096930 12471 raft_consensus.cc:374] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:21.097298 12471 raft_consensus.cc:729] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba02182353974e39b108fc9154ca01ea, State: Initialized, Role: FOLLOWER
I20260620 09:20:21.097961 12471 consensus_queue.cc:260] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.099426 12474 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Bootstrap starting.
I20260620 09:20:21.100545 12472 tablet_bootstrap.cc:654] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:21.102367 12306 heartbeater.cc:503] Master 127.9.154.254:46735 was elected leader, sending a full tablet report...
I20260620 09:20:21.102826 12471 ts_tablet_manager.cc:1428] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
W20260620 09:20:21.103111 12471 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260620 09:20:21.106278 12474 tablet_bootstrap.cc:654] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:21.106791 12472 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: No bootstrap required, opened a new log
I20260620 09:20:21.107329 12472 ts_tablet_manager.cc:1397] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260620 09:20:21.110282 12472 raft_consensus.cc:348] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.111091 12472 raft_consensus.cc:374] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:21.111421 12472 raft_consensus.cc:729] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 108240cb607f446fb35dceaa2c0d5829, State: Initialized, Role: FOLLOWER
I20260620 09:20:21.111577 12474 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: No bootstrap required, opened a new log
I20260620 09:20:21.112066 12474 ts_tablet_manager.cc:1397] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
I20260620 09:20:21.112208 12472 consensus_queue.cc:260] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.114871 12381 heartbeater.cc:503] Master 127.9.154.254:46735 was elected leader, sending a full tablet report...
I20260620 09:20:21.115315 12472 ts_tablet_manager.cc:1428] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
W20260620 09:20:21.115633 12472 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260620 09:20:21.115120 12474 raft_consensus.cc:348] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.115953 12474 raft_consensus.cc:374] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:21.116356 12474 raft_consensus.cc:729] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5732e678a44a4230ab954a5a4c3a5b50, State: Initialized, Role: FOLLOWER
I20260620 09:20:21.117009 12474 consensus_queue.cc:260] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.119118 12455 heartbeater.cc:503] Master 127.9.154.254:46735 was elected leader, sending a full tablet report...
I20260620 09:20:21.119364 12474 ts_tablet_manager.cc:1428] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
W20260620 09:20:21.119599 12474 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
W20260620 09:20:21.200444 12456 tablet.cc:2369] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 09:20:21.322382 12475 raft_consensus.cc:482] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:21.322825 12475 raft_consensus.cc:504] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.324724 12475 leader_election.cc:288] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159), 5732e678a44a4230ab954a5a4c3a5b50 (127.9.154.195:40375)
I20260620 09:20:21.340226 12356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d57bcb38f4382af4e732fa2a6b26c" candidate_uuid: "ba02182353974e39b108fc9154ca01ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "108240cb607f446fb35dceaa2c0d5829" is_pre_election: true
I20260620 09:20:21.340986 12356 raft_consensus.cc:2454] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba02182353974e39b108fc9154ca01ea in term 0.
I20260620 09:20:21.342077 12247 leader_election.cc:302] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 108240cb607f446fb35dceaa2c0d5829, ba02182353974e39b108fc9154ca01ea; no voters: 
I20260620 09:20:21.342887 12475 raft_consensus.cc:2781] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:20:21.342816 12430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d57bcb38f4382af4e732fa2a6b26c" candidate_uuid: "ba02182353974e39b108fc9154ca01ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5732e678a44a4230ab954a5a4c3a5b50" is_pre_election: true
I20260620 09:20:21.343389 12475 raft_consensus.cc:482] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:20:21.343657 12430 raft_consensus.cc:2454] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba02182353974e39b108fc9154ca01ea in term 0.
I20260620 09:20:21.343784 12475 raft_consensus.cc:3037] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:21.348361 12475 raft_consensus.cc:504] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.349803 12475 leader_election.cc:288] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [CANDIDATE]: Term 1 election: Requested vote from peers 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159), 5732e678a44a4230ab954a5a4c3a5b50 (127.9.154.195:40375)
I20260620 09:20:21.350618 12356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d57bcb38f4382af4e732fa2a6b26c" candidate_uuid: "ba02182353974e39b108fc9154ca01ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "108240cb607f446fb35dceaa2c0d5829"
I20260620 09:20:21.350843 12430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d57bcb38f4382af4e732fa2a6b26c" candidate_uuid: "ba02182353974e39b108fc9154ca01ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5732e678a44a4230ab954a5a4c3a5b50"
I20260620 09:20:21.351202 12356 raft_consensus.cc:3037] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:21.351526 12430 raft_consensus.cc:3037] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:21.356362 12356 raft_consensus.cc:2454] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba02182353974e39b108fc9154ca01ea in term 1.
I20260620 09:20:21.356804 12430 raft_consensus.cc:2454] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba02182353974e39b108fc9154ca01ea in term 1.
I20260620 09:20:21.357388 12247 leader_election.cc:302] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 108240cb607f446fb35dceaa2c0d5829, ba02182353974e39b108fc9154ca01ea; no voters: 
I20260620 09:20:21.358171 12475 raft_consensus.cc:2781] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:21.359148 12475 raft_consensus.cc:686] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 LEADER]: Becoming Leader. State: Replica: ba02182353974e39b108fc9154ca01ea, State: Running, Role: LEADER
I20260620 09:20:21.359810 12475 consensus_queue.cc:237] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.367556 12179 catalog_manager.cc:5495] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea reported cstate change: term changed from 0 to 1, leader changed from <none> to ba02182353974e39b108fc9154ca01ea (127.9.154.193). New cstate: current_term: 1 leader_uuid: "ba02182353974e39b108fc9154ca01ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } health_report { overall_health: UNKNOWN } } }
I20260620 09:20:21.453778 12346 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:55770
I20260620 09:20:21.455554 12485 tablet_replica.cc:330] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: stopping tablet replica
I20260620 09:20:21.456190 12485 raft_consensus.cc:2229] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:21.456609 12485 raft_consensus.cc:2258] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:21.458530 12485 ts_tablet_manager.cc:1905] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 09:20:21.468243 12485 ts_tablet_manager.cc:1918] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260620 09:20:21.468636 12485 log.cc:1196] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root/wals/253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.472371 12486 ts_tablet_manager.cc:927] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Initiating tablet copy from peer ba02182353974e39b108fc9154ca01ea (127.9.154.193:41767)
I20260620 09:20:21.473824 12486 tablet_copy_client.cc:316] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet copy: Beginning tablet copy session from remote peer at address 127.9.154.193:41767
I20260620 09:20:21.484845 12291 tablet_copy_service.cc:140] P ba02182353974e39b108fc9154ca01ea: Received BeginTabletCopySession request for tablet 253d57bcb38f4382af4e732fa2a6b26c from peer 108240cb607f446fb35dceaa2c0d5829 ({username='slave'} at 127.0.0.1:43786)
I20260620 09:20:21.485375 12291 tablet_copy_service.cc:161] P ba02182353974e39b108fc9154ca01ea: Beginning new tablet copy session on tablet 253d57bcb38f4382af4e732fa2a6b26c from peer 108240cb607f446fb35dceaa2c0d5829 at {username='slave'} at 127.0.0.1:43786: session id = 108240cb607f446fb35dceaa2c0d5829-253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.491189 12291 tablet_copy_source_session.cc:205] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 09:20:21.494102 12486 ts_tablet_manager.cc:1905] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260620 09:20:21.504181 12486 ts_tablet_manager.cc:1918] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260620 09:20:21.504709 12486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d57bcb38f4382af4e732fa2a6b26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:21.509699 12486 tablet_copy_client.cc:791] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet copy: Starting download of 0 data blocks...
I20260620 09:20:21.510192 12486 tablet_copy_client.cc:655] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet copy: Starting download of 1 WAL segments...
I20260620 09:20:21.512082 12179 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35042:
table { table_id: "fa28f0155467438a99af3d0556e9c9ff" table_name: "test-table" }
I20260620 09:20:21.512717 12179 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35042:
table { table_id: "fa28f0155467438a99af3d0556e9c9ff" table_name: "test-table" }
I20260620 09:20:21.514508 12486 tablet_copy_client.cc:531] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 09:20:21.521905 12486 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Bootstrap starting.
I20260620 09:20:21.523535 12179 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: Sending DeleteTablet for 3 replicas of tablet 253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.525647 12271 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 09:20:21 UTC) from {username='slave'} at 127.0.0.1:43772
I20260620 09:20:21.525867 12420 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 09:20:21 UTC) from {username='slave'} at 127.0.0.1:52080
I20260620 09:20:21.526785 12346 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 09:20:21 UTC) from {username='slave'} at 127.0.0.1:55760
W20260620 09:20:21.529271 12166 catalog_manager.cc:4821] TS 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159): delete failed for tablet 253d57bcb38f4382af4e732fa2a6b26c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 253d57bcb38f4382af4e732fa2a6b26c already in progress: copying tablet
I20260620 09:20:21.532163 12490 tablet_replica.cc:330] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: stopping tablet replica
I20260620 09:20:21.532735 12489 tablet_replica.cc:330] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: stopping tablet replica
I20260620 09:20:21.533526 12489 raft_consensus.cc:2229] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:21.533043 12490 raft_consensus.cc:2229] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:21.534189 12490 raft_consensus.cc:2258] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:21.534446 12489 pending_rounds.cc:62] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Trying to abort 1 pending ops.
I20260620 09:20:21.534780 12489 pending_rounds.cc:68] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298855818696876032 op_type: NO_OP noop_request { }
I20260620 09:20:21.535895 12489 raft_consensus.cc:2866] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 09:20:21.536290 12489 raft_consensus.cc:2258] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:21.537065 12490 ts_tablet_manager.cc:1905] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 09:20:21.539244 12486 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 09:20:21.539490 12489 ts_tablet_manager.cc:1905] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 09:20:21.539883 12486 tablet_bootstrap.cc:492] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Bootstrap complete.
I20260620 09:20:21.540380 12486 ts_tablet_manager.cc:1397] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260620 09:20:21.542650 12486 raft_consensus.cc:348] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.543316 12486 raft_consensus.cc:729] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 108240cb607f446fb35dceaa2c0d5829, State: Initialized, Role: FOLLOWER
I20260620 09:20:21.543900 12486 consensus_queue.cc:260] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba02182353974e39b108fc9154ca01ea" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 41767 } } peers { permanent_uuid: "108240cb607f446fb35dceaa2c0d5829" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 45159 } } peers { permanent_uuid: "5732e678a44a4230ab954a5a4c3a5b50" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 40375 } }
I20260620 09:20:21.545799 12486 ts_tablet_manager.cc:1428] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260620 09:20:21.546041 12486 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260620 09:20:21.550338 12346 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 09:20:21 UTC) from {username='slave'} at 127.0.0.1:55760
W20260620 09:20:21.551994 12166 catalog_manager.cc:4821] TS 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159): delete failed for tablet 253d57bcb38f4382af4e732fa2a6b26c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 253d57bcb38f4382af4e732fa2a6b26c already in progress: copying tablet
I20260620 09:20:21.553526 12490 ts_tablet_manager.cc:1918] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 09:20:21.553860 12490 log.cc:1196] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-2-root/wals/253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.554445 12490 ts_tablet_manager.cc:1939] T 253d57bcb38f4382af4e732fa2a6b26c P 5732e678a44a4230ab954a5a4c3a5b50: Deleting consensus metadata
I20260620 09:20:21.555565 12489 ts_tablet_manager.cc:1918] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 09:20:21.555876 12489 log.cc:1196] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-0-root/wals/253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.556622 12489 ts_tablet_manager.cc:1939] T 253d57bcb38f4382af4e732fa2a6b26c P ba02182353974e39b108fc9154ca01ea: Deleting consensus metadata
I20260620 09:20:21.557013 12163 catalog_manager.cc:4841] TS 5732e678a44a4230ab954a5a4c3a5b50 (127.9.154.195:40375): tablet 253d57bcb38f4382af4e732fa2a6b26c (table test-table [id=fa28f0155467438a99af3d0556e9c9ff]) successfully deleted
I20260620 09:20:21.557859 12165 catalog_manager.cc:4841] TS ba02182353974e39b108fc9154ca01ea (127.9.154.193:41767): tablet 253d57bcb38f4382af4e732fa2a6b26c (table test-table [id=fa28f0155467438a99af3d0556e9c9ff]) successfully deleted
I20260620 09:20:21.598384 12291 tablet_copy_service.cc:342] P ba02182353974e39b108fc9154ca01ea: Request end of tablet copy session 108240cb607f446fb35dceaa2c0d5829-253d57bcb38f4382af4e732fa2a6b26c received from {username='slave'} at 127.0.0.1:43786
I20260620 09:20:21.598796 12291 tablet_copy_service.cc:433] P ba02182353974e39b108fc9154ca01ea: ending tablet copy session 108240cb607f446fb35dceaa2c0d5829-253d57bcb38f4382af4e732fa2a6b26c on tablet 253d57bcb38f4382af4e732fa2a6b26c with peer 108240cb607f446fb35dceaa2c0d5829
I20260620 09:20:21.601586 12346 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d57bcb38f4382af4e732fa2a6b26c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 09:20:21 UTC) from {username='slave'} at 127.0.0.1:55760
I20260620 09:20:21.602356 12485 tablet_replica.cc:330] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: stopping tablet replica
I20260620 09:20:21.603364 12485 raft_consensus.cc:2229] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:21.603781 12485 pending_rounds.cc:62] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Trying to abort 1 pending ops.
I20260620 09:20:21.604007 12485 pending_rounds.cc:68] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298855818696876032 op_type: NO_OP noop_request { }
I20260620 09:20:21.604329 12485 raft_consensus.cc:2866] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 09:20:21.604651 12485 raft_consensus.cc:2258] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:21.606520 12485 ts_tablet_manager.cc:1905] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 09:20:21.616012 12485 ts_tablet_manager.cc:1918] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 09:20:21.616346 12485 log.cc:1196] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1781947168426282-9835-0/minicluster-data/ts-1-root/wals/253d57bcb38f4382af4e732fa2a6b26c
I20260620 09:20:21.616915 12485 ts_tablet_manager.cc:1939] T 253d57bcb38f4382af4e732fa2a6b26c P 108240cb607f446fb35dceaa2c0d5829: Deleting consensus metadata
I20260620 09:20:21.619050 12166 catalog_manager.cc:4841] TS 108240cb607f446fb35dceaa2c0d5829 (127.9.154.194:45159): tablet 253d57bcb38f4382af4e732fa2a6b26c (table test-table [id=fa28f0155467438a99af3d0556e9c9ff]) successfully deleted
I20260620 09:20:21.662166  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:21.685987  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:21.703293  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:21.712112  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:20:21.728724  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:21.745321  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:20:21.754652  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:20:21.771324  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:21.787742  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:20:21.796494  9835 master.cc:537] Master@127.9.154.254:46735 shutting down...
I20260620 09:20:21.811146  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:21.811672  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:21.811980  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1988fdffc6e54a81bfe848228d65e545: stopping tablet replica
I20260620 09:20:21.831118  9835 master.cc:552] Master@127.9.154.254:46735 shutdown complete.
[       OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1436 ms)
[----------] 4 tests from TsTabletManagerITest (42828 ms total)

[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN      ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260620 09:20:21.855343  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:37721
I20260620 09:20:21.856292  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:21.861116 12496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:21.862015 12497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:21.863449 12499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:21.864727  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:21.865412  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:21.865573  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:21.865687  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947221865679 us; error 0 us; skew 500 ppm
I20260620 09:20:21.866112  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:21.871906  9835 webserver.cc:460] Webserver started at http://127.9.154.254:35749/ using document root <none> and password file <none>
I20260620 09:20:21.872653  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:21.872830  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:21.873162  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:21.874329  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "d2c6c85d34744b848b31167ba8682f8a"
format_stamp: "Formatted at 2026-06-20 09:20:21 on dist-test-slave-zmgx"
I20260620 09:20:21.878775  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260620 09:20:21.882552 12504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:21.883395  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:20:21.883646  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "d2c6c85d34744b848b31167ba8682f8a"
format_stamp: "Formatted at 2026-06-20 09:20:21 on dist-test-slave-zmgx"
I20260620 09:20:21.883882  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:21.897514  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:21.898514  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:21.932708  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:37721
I20260620 09:20:21.932796 12555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:37721 every 8 connection(s)
I20260620 09:20:21.936408 12556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:21.945376 12556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a: Bootstrap starting.
I20260620 09:20:21.949251 12556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:21.953356 12556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a: No bootstrap required, opened a new log
I20260620 09:20:21.955405 12556 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER }
I20260620 09:20:21.955827 12556 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:21.956053 12556 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c6c85d34744b848b31167ba8682f8a, State: Initialized, Role: FOLLOWER
I20260620 09:20:21.956647 12556 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER }
I20260620 09:20:21.957113 12556 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:21.957399 12556 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:21.957687 12556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:21.962000 12556 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER }
I20260620 09:20:21.962558 12556 leader_election.cc:302] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2c6c85d34744b848b31167ba8682f8a; no voters: 
I20260620 09:20:21.963701 12556 leader_election.cc:288] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:21.964027 12559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:21.965417 12559 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 1 LEADER]: Becoming Leader. State: Replica: d2c6c85d34744b848b31167ba8682f8a, State: Running, Role: LEADER
I20260620 09:20:21.966121 12559 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER }
I20260620 09:20:21.966763 12556 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:21.968984 12560 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2c6c85d34744b848b31167ba8682f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER } }
I20260620 09:20:21.969769 12560 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:21.969007 12561 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c6c85d34744b848b31167ba8682f8a. Latest consensus state: current_term: 1 leader_uuid: "d2c6c85d34744b848b31167ba8682f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c6c85d34744b848b31167ba8682f8a" member_type: VOTER } }
I20260620 09:20:21.970497 12561 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:21.973110 12564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:21.981029 12564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:21.985349  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:21.995137 12564 catalog_manager.cc:1347] Generated new cluster ID: 42d4bde2eacf4d64924e64a8328137b6
I20260620 09:20:21.995455 12564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:22.023545 12564 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:22.025192 12564 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:22.049234 12564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a: Generated new TSK 0
I20260620 09:20:22.050004 12564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:22.117218  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:22.122962 12577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:22.123754 12578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:22.126618 12580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:22.127164  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:22.129617  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:22.129796  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:22.129909  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947222129902 us; error 0 us; skew 500 ppm
I20260620 09:20:22.130438  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:22.133095  9835 webserver.cc:460] Webserver started at http://127.9.154.193:38133/ using document root <none> and password file <none>
I20260620 09:20:22.133755  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:22.134016  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:22.134402  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:22.135983  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "8b8a0b3feb48478f9ef8443122f03528"
format_stamp: "Formatted at 2026-06-20 09:20:22 on dist-test-slave-zmgx"
I20260620 09:20:22.141496  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260620 09:20:22.144600 12585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:22.145431  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:20:22.145771  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "8b8a0b3feb48478f9ef8443122f03528"
format_stamp: "Formatted at 2026-06-20 09:20:22 on dist-test-slave-zmgx"
I20260620 09:20:22.146090  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:22.159719  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:22.160763  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:22.165431  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:22.165717  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:22.166021  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:22.166241  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:22.229383  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:43489
I20260620 09:20:22.229516 12655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:43489 every 8 connection(s)
I20260620 09:20:22.233911 12656 heartbeater.cc:347] Connected to a master server at 127.9.154.254:37721
I20260620 09:20:22.234324 12656 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:22.234997 12656 heartbeater.cc:511] Master 127.9.154.254:37721 requested a full tablet report, sending...
I20260620 09:20:22.236774 12521 ts_manager.cc:194] Registered new tserver with Master: 8b8a0b3feb48478f9ef8443122f03528 (127.9.154.193:43489)
I20260620 09:20:22.237438  9835 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004866626s
I20260620 09:20:22.238612 12521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52342
I20260620 09:20:22.273586 12621 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260620 09:20:22.274901 12621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:22.286415 12666 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Bootstrap starting.
I20260620 09:20:22.290681 12666 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:22.294643 12666 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: No bootstrap required, opened a new log
I20260620 09:20:22.295024 12666 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.001s
I20260620 09:20:22.296950 12666 raft_consensus.cc:348] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.297354 12666 raft_consensus.cc:374] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:22.297610 12666 raft_consensus.cc:729] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8a0b3feb48478f9ef8443122f03528, State: Initialized, Role: FOLLOWER
I20260620 09:20:22.298210 12666 consensus_queue.cc:260] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.298758 12666 raft_consensus.cc:388] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:22.299002 12666 raft_consensus.cc:482] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:22.299292 12666 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:22.303946 12666 raft_consensus.cc:504] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.304512 12666 leader_election.cc:302] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8a0b3feb48478f9ef8443122f03528; no voters: 
I20260620 09:20:22.305697 12666 leader_election.cc:288] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:22.306151 12668 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:22.307732 12656 heartbeater.cc:503] Master 127.9.154.254:37721 was elected leader, sending a full tablet report...
I20260620 09:20:22.307667 12668 raft_consensus.cc:686] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 LEADER]: Becoming Leader. State: Replica: 8b8a0b3feb48478f9ef8443122f03528, State: Running, Role: LEADER
I20260620 09:20:22.308959 12666 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.007s
I20260620 09:20:22.308769 12668 consensus_queue.cc:237] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.315691 12669 tablet_replica.cc:439] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b8a0b3feb48478f9ef8443122f03528" committed_config { opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } } }
I20260620 09:20:22.316352 12669 tablet_replica.cc:442] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:22.316390 12670 tablet_replica.cc:439] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: TxnStatusTablet state changed. Reason: New leader 8b8a0b3feb48478f9ef8443122f03528. Latest consensus state: current_term: 1 leader_uuid: "8b8a0b3feb48478f9ef8443122f03528" committed_config { opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } } }
I20260620 09:20:22.317227 12670 tablet_replica.cc:442] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: This TxnStatusTablet replica's current role is: LEADER
W20260620 09:20:22.317889 12521 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:22.319092 12673 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:22.319586 12673 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260620 09:20:22.322484 12521 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:22.352007  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:22.383987  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:22.384850  9835 tablet_replica.cc:330] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: stopping tablet replica
I20260620 09:20:22.385481  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:22.385946  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:22.408071  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:22.421083  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:22.428539 12676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:22.428789 12677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:22.432127  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:22.432865 12679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:22.433926  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:22.434175  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:22.434450  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947222434420 us; error 0 us; skew 500 ppm
I20260620 09:20:22.435030  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:22.438206  9835 webserver.cc:460] Webserver started at http://127.9.154.193:38133/ using document root <none> and password file <none>
I20260620 09:20:22.438779  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:22.438987  9835 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 09:20:22.443236  9835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260620 09:20:22.446326 12684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:22.447209  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260620 09:20:22.447532  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "8b8a0b3feb48478f9ef8443122f03528"
format_stamp: "Formatted at 2026-06-20 09:20:22 on dist-test-slave-zmgx"
I20260620 09:20:22.447875  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:22.473240  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:22.474386  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:22.481758 12693 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260620 09:20:22.491391  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 09:20:22.491722  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.011s	user 0.001s	sys 0.000s
I20260620 09:20:22.492053  9835 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 09:20:22.498956  9835 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 09:20:22.499238  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.007s	user 0.007s	sys 0.000s
I20260620 09:20:22.499326 12693 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Bootstrap starting.
I20260620 09:20:22.556145 12693 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:20:22.557000 12693 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Bootstrap complete.
I20260620 09:20:22.557565 12693 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Time spent bootstrapping tablet: real 0.058s	user 0.038s	sys 0.016s
I20260620 09:20:22.559461 12693 raft_consensus.cc:348] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.559952 12693 raft_consensus.cc:729] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8a0b3feb48478f9ef8443122f03528, State: Initialized, Role: FOLLOWER
I20260620 09:20:22.560804 12693 consensus_queue.cc:260] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.561553 12693 raft_consensus.cc:388] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:22.561900 12693 raft_consensus.cc:482] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:22.562287 12693 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:20:22.569231 12693 raft_consensus.cc:504] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.569851 12693 leader_election.cc:302] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8a0b3feb48478f9ef8443122f03528; no voters: 
I20260620 09:20:22.571786 12693 leader_election.cc:288] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260620 09:20:22.572151 12721 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 09:20:22.580396 12721 raft_consensus.cc:686] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 2 LEADER]: Becoming Leader. State: Replica: 8b8a0b3feb48478f9ef8443122f03528, State: Running, Role: LEADER
I20260620 09:20:22.581323 12721 consensus_queue.cc:237] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } }
I20260620 09:20:22.582157 12693 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528: Time spent starting tablet: real 0.024s	user 0.017s	sys 0.007s
I20260620 09:20:22.585511 12724 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader 8b8a0b3feb48478f9ef8443122f03528. Latest consensus state: current_term: 2 leader_uuid: "8b8a0b3feb48478f9ef8443122f03528" committed_config { opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } } }
I20260620 09:20:22.586088 12724 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:22.590253 12723 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8b8a0b3feb48478f9ef8443122f03528" committed_config { opid_index: -1 peers { permanent_uuid: "8b8a0b3feb48478f9ef8443122f03528" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 43489 } } }
I20260620 09:20:22.592685 12723 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:22.601897 12728 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:22.602625 12728 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 09:20:22.640800  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:43489
I20260620 09:20:22.640921 12761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:43489 every 8 connection(s)
I20260620 09:20:22.648561 12762 heartbeater.cc:347] Connected to a master server at 127.9.154.254:37721
I20260620 09:20:22.649250 12762 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:22.649570  9835 tablet_server.cc:178] TabletServer@127.9.154.193:43489 shutting down...
I20260620 09:20:22.652276 12762 heartbeater.cc:511] Master 127.9.154.254:37721 requested a full tablet report, sending...
I20260620 09:20:22.656834 12521 ts_manager.cc:194] Re-registered known tserver with Master: 8b8a0b3feb48478f9ef8443122f03528 (127.9.154.193:43489)
W20260620 09:20:22.657466 12521 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:22.659754 12521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52376
I20260620 09:20:22.664105 12762 heartbeater.cc:503] Master 127.9.154.254:37721 was elected leader, sending a full tablet report...
W20260620 09:20:22.667960 12521 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:22.683007  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:22.684263  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:22.684803  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 2 LEADER]: Raft consensus shutting down.
I20260620 09:20:22.685349  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 8b8a0b3feb48478f9ef8443122f03528 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:22.697696  9835 tablet_server.cc:194] TabletServer@127.9.154.193:43489 shutdown complete.
I20260620 09:20:22.708647  9835 master.cc:537] Master@127.9.154.254:37721 shutting down...
I20260620 09:20:22.728245  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:22.728811  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:22.729128  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P d2c6c85d34744b848b31167ba8682f8a: stopping tablet replica
I20260620 09:20:22.747990  9835 master.cc:552] Master@127.9.154.254:37721 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (916 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260620 09:20:22.771685  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:44253
I20260620 09:20:22.772672  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:22.778126 12768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:22.779938 12769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:22.782872  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:22.783372 12771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:22.784293  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:22.784569  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:22.784794  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947222784774 us; error 0 us; skew 500 ppm
I20260620 09:20:22.785553  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:22.788801  9835 webserver.cc:460] Webserver started at http://127.9.154.254:35183/ using document root <none> and password file <none>
I20260620 09:20:22.789441  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:22.789690  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:22.790019  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:22.791572  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "16968e31b69f495b81e9cd1e5abc8a07"
format_stamp: "Formatted at 2026-06-20 09:20:22 on dist-test-slave-zmgx"
I20260620 09:20:22.797822  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260620 09:20:22.802723 12776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:22.803694  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260620 09:20:22.804028  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "16968e31b69f495b81e9cd1e5abc8a07"
format_stamp: "Formatted at 2026-06-20 09:20:22 on dist-test-slave-zmgx"
I20260620 09:20:22.804407  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:22.834372  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:22.835789  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:22.885812  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:44253
I20260620 09:20:22.885903 12827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:44253 every 8 connection(s)
I20260620 09:20:22.890681 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:22.902026 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07: Bootstrap starting.
I20260620 09:20:22.906801 12828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:22.911931 12828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07: No bootstrap required, opened a new log
I20260620 09:20:22.914075 12828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER }
I20260620 09:20:22.914633 12828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:22.914860 12828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16968e31b69f495b81e9cd1e5abc8a07, State: Initialized, Role: FOLLOWER
I20260620 09:20:22.915544 12828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER }
I20260620 09:20:22.916054 12828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:22.916281 12828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:22.916570 12828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:22.921105 12828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER }
I20260620 09:20:22.921684 12828 leader_election.cc:302] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16968e31b69f495b81e9cd1e5abc8a07; no voters: 
I20260620 09:20:22.923112 12828 leader_election.cc:288] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:22.923456 12831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:22.925223 12831 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 1 LEADER]: Becoming Leader. State: Replica: 16968e31b69f495b81e9cd1e5abc8a07, State: Running, Role: LEADER
I20260620 09:20:22.926007 12831 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER }
I20260620 09:20:22.927158 12828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:22.930460 12833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16968e31b69f495b81e9cd1e5abc8a07. Latest consensus state: current_term: 1 leader_uuid: "16968e31b69f495b81e9cd1e5abc8a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER } }
I20260620 09:20:22.931067 12833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:22.929437 12832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16968e31b69f495b81e9cd1e5abc8a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16968e31b69f495b81e9cd1e5abc8a07" member_type: VOTER } }
I20260620 09:20:22.932358 12832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:22.942209 12836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:22.949465 12836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:22.950630  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:22.959746 12836 catalog_manager.cc:1347] Generated new cluster ID: 9f58e34cc0e34433837608d6b338c488
I20260620 09:20:22.960085 12836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:22.986527 12836 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:22.988497 12836 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:23.009434 12836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07: Generated new TSK 0
I20260620 09:20:23.010167 12836 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:23.016916  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:23.023732 12849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:23.025544 12850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:23.029270  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:23.029379 12852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:23.030676  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:23.030896  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:23.031080  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947223031061 us; error 0 us; skew 500 ppm
I20260620 09:20:23.031615  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:23.034469  9835 webserver.cc:460] Webserver started at http://127.9.154.193:44369/ using document root <none> and password file <none>
I20260620 09:20:23.034943  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:23.035147  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:23.035405  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:23.036491  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "0ff5b5bd90944893875e2c3c7a7aef1e"
format_stamp: "Formatted at 2026-06-20 09:20:23 on dist-test-slave-zmgx"
I20260620 09:20:23.041013  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260620 09:20:23.044656 12857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.045589  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 09:20:23.045925  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "0ff5b5bd90944893875e2c3c7a7aef1e"
format_stamp: "Formatted at 2026-06-20 09:20:23 on dist-test-slave-zmgx"
I20260620 09:20:23.046265  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:23.066851  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:23.067912  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:23.078584  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:23.078922  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.079237  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:23.079442  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.171506  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:35255
I20260620 09:20:23.171605 12927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:35255 every 8 connection(s)
I20260620 09:20:23.176257  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 09:20:23.176730 12928 heartbeater.cc:347] Connected to a master server at 127.9.154.254:44253
I20260620 09:20:23.177105 12928 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:23.177897 12928 heartbeater.cc:511] Master 127.9.154.254:44253 requested a full tablet report, sending...
I20260620 09:20:23.180132 12793 ts_manager.cc:194] Registered new tserver with Master: 0ff5b5bd90944893875e2c3c7a7aef1e (127.9.154.193:35255)
I20260620 09:20:23.183657 12793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49596
W20260620 09:20:23.184602 12930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:23.188336 12931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:23.194342 12933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:23.194947  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:23.195845  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:23.196110  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:23.196302  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947223196290 us; error 0 us; skew 500 ppm
I20260620 09:20:23.196969  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:23.199752  9835 webserver.cc:460] Webserver started at http://127.9.154.194:43127/ using document root <none> and password file <none>
I20260620 09:20:23.200342  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:23.200567  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:23.200861  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:23.202246  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "0c6373b37463403a9470af8b64480f2d"
format_stamp: "Formatted at 2026-06-20 09:20:23 on dist-test-slave-zmgx"
I20260620 09:20:23.208124  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260620 09:20:23.212749 12938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.213887  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 09:20:23.214268  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "0c6373b37463403a9470af8b64480f2d"
format_stamp: "Formatted at 2026-06-20 09:20:23 on dist-test-slave-zmgx"
I20260620 09:20:23.214627  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:23.249467  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:23.250650  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:23.257898  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:23.258252  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.258610  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:23.258800  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.335527  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:43635
I20260620 09:20:23.335691 13007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:43635 every 8 connection(s)
I20260620 09:20:23.340288 13008 heartbeater.cc:347] Connected to a master server at 127.9.154.254:44253
I20260620 09:20:23.340662 13008 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:23.341312 13008 heartbeater.cc:511] Master 127.9.154.254:44253 requested a full tablet report, sending...
I20260620 09:20:23.343518 12793 ts_manager.cc:194] Registered new tserver with Master: 0c6373b37463403a9470af8b64480f2d (127.9.154.194:43635)
I20260620 09:20:23.343979  9835 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.005196848s
I20260620 09:20:23.345958 12793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49620
I20260620 09:20:23.389528 12893 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260620 09:20:23.390849 12893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:23.403293 13018 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Bootstrap starting.
I20260620 09:20:23.408018 13018 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:23.412981 13018 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: No bootstrap required, opened a new log
I20260620 09:20:23.413483 13018 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260620 09:20:23.416142 13018 raft_consensus.cc:348] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.416750 13018 raft_consensus.cc:374] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:23.417050 13018 raft_consensus.cc:729] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff5b5bd90944893875e2c3c7a7aef1e, State: Initialized, Role: FOLLOWER
I20260620 09:20:23.417699 13018 consensus_queue.cc:260] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.418395 13018 raft_consensus.cc:388] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:23.418709 13018 raft_consensus.cc:482] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:23.419045 13018 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:23.425824 13018 raft_consensus.cc:504] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.426548 13018 leader_election.cc:302] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ff5b5bd90944893875e2c3c7a7aef1e; no voters: 
I20260620 09:20:23.427884 13018 leader_election.cc:288] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:23.428265 13020 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:23.430119 12928 heartbeater.cc:503] Master 127.9.154.254:44253 was elected leader, sending a full tablet report...
I20260620 09:20:23.430594 13018 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Time spent starting tablet: real 0.017s	user 0.018s	sys 0.001s
I20260620 09:20:23.430629 13020 raft_consensus.cc:686] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 LEADER]: Becoming Leader. State: Replica: 0ff5b5bd90944893875e2c3c7a7aef1e, State: Running, Role: LEADER
I20260620 09:20:23.431751 13020 consensus_queue.cc:237] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.435887 13021 tablet_replica.cc:439] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" committed_config { opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } } }
I20260620 09:20:23.436472 13021 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: This TxnStatusTablet replica's current role is: LEADER
W20260620 09:20:23.439067 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:23.441738 13022 tablet_replica.cc:439] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: TxnStatusTablet state changed. Reason: New leader 0ff5b5bd90944893875e2c3c7a7aef1e. Latest consensus state: current_term: 1 leader_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" committed_config { opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } } }
I20260620 09:20:23.443274 13022 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:23.445756 13025 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:23.446251 13025 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260620 09:20:23.447891 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:23.509887 13029 ts_tablet_manager.cc:927] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Initiating tablet copy from peer 0ff5b5bd90944893875e2c3c7a7aef1e (127.9.154.193:35255)
I20260620 09:20:23.511660 13029 tablet_copy_client.cc:316] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.154.193:35255
I20260620 09:20:23.522948 12913 tablet_copy_service.cc:140] P 0ff5b5bd90944893875e2c3c7a7aef1e: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer 0c6373b37463403a9470af8b64480f2d ({username='slave'} at 127.0.0.1:57744)
I20260620 09:20:23.523468 12913 tablet_copy_service.cc:161] P 0ff5b5bd90944893875e2c3c7a7aef1e: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer 0c6373b37463403a9470af8b64480f2d at {username='slave'} at 127.0.0.1:57744: session id = 0c6373b37463403a9470af8b64480f2d-11111111111111111111111111111111
I20260620 09:20:23.528729 12913 tablet_copy_source_session.cc:205] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 09:20:23.531543 13029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:23.541810 13029 tablet_copy_client.cc:791] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: tablet copy: Starting download of 0 data blocks...
I20260620 09:20:23.542363 13029 tablet_copy_client.cc:655] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: tablet copy: Starting download of 1 WAL segments...
I20260620 09:20:23.546113 13029 tablet_copy_client.cc:531] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 09:20:23.553829 13029 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Bootstrap starting.
I20260620 09:20:23.580404 13029 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:20:23.581245 13029 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Bootstrap complete.
I20260620 09:20:23.581874 13029 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.004s
I20260620 09:20:23.584204 13029 raft_consensus.cc:348] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.584728 13029 raft_consensus.cc:729] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 0c6373b37463403a9470af8b64480f2d, State: Initialized, Role: NON_PARTICIPANT
I20260620 09:20:23.585276 13029 consensus_queue.cc:260] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.587208 13008 heartbeater.cc:503] Master 127.9.154.254:44253 was elected leader, sending a full tablet report...
I20260620 09:20:23.587023 13032 tablet_replica.cc:439] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } } }
I20260620 09:20:23.587647 13029 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260620 09:20:23.587811 13032 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260620 09:20:23.589511 12913 tablet_copy_service.cc:342] P 0ff5b5bd90944893875e2c3c7a7aef1e: Request end of tablet copy session 0c6373b37463403a9470af8b64480f2d-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:57744
I20260620 09:20:23.589879 12913 tablet_copy_service.cc:433] P 0ff5b5bd90944893875e2c3c7a7aef1e: ending tablet copy session 0c6373b37463403a9470af8b64480f2d-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer 0c6373b37463403a9470af8b64480f2d
W20260620 09:20:23.590452 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260620 09:20:23.594998 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:23.607093  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:23.631819  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:23.632674  9835 tablet_replica.cc:330] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: stopping tablet replica
I20260620 09:20:23.633282  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:23.633800  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:23.656807  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:23.669385  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:23.680721 13034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:23.682971 13033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:23.683857  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:23.684273 13036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:23.685312  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:23.685513  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:23.685750  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947223685716 us; error 0 us; skew 500 ppm
I20260620 09:20:23.686414  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:23.689512  9835 webserver.cc:460] Webserver started at http://127.9.154.193:44369/ using document root <none> and password file <none>
I20260620 09:20:23.690034  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:23.690325  9835 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 09:20:23.694321  9835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260620 09:20:23.697589 13041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:23.698485  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 09:20:23.698823  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "0ff5b5bd90944893875e2c3c7a7aef1e"
format_stamp: "Formatted at 2026-06-20 09:20:23 on dist-test-slave-zmgx"
I20260620 09:20:23.699175  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:23.714021  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:23.715358  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:23.722829 13050 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260620 09:20:23.729494  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 09:20:23.729797  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s	user 0.000s	sys 0.002s
I20260620 09:20:23.730093  9835 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 09:20:23.735787  9835 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 09:20:23.736004  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.006s	user 0.006s	sys 0.000s
I20260620 09:20:23.736187 13050 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Bootstrap starting.
I20260620 09:20:23.779973 13050 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:20:23.781111 13050 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Bootstrap complete.
I20260620 09:20:23.781883 13050 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.009s
I20260620 09:20:23.784586 13050 raft_consensus.cc:348] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.785261 13050 raft_consensus.cc:729] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff5b5bd90944893875e2c3c7a7aef1e, State: Initialized, Role: FOLLOWER
I20260620 09:20:23.786187 13050 consensus_queue.cc:260] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.786938 13050 raft_consensus.cc:388] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:23.787694 13050 raft_consensus.cc:482] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:23.788352 13050 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 1 FOLLOWER]: Advancing to term 2
I20260620 09:20:23.794898 13050 raft_consensus.cc:504] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.795641 13050 leader_election.cc:302] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ff5b5bd90944893875e2c3c7a7aef1e; no voters: 
I20260620 09:20:23.797214 13050 leader_election.cc:288] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260620 09:20:23.797561 13076 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 2 FOLLOWER]: Leader election won for term 2
I20260620 09:20:23.806634 13076 raft_consensus.cc:686] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 2 LEADER]: Becoming Leader. State: Replica: 0ff5b5bd90944893875e2c3c7a7aef1e, State: Running, Role: LEADER
I20260620 09:20:23.806654 13050 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e: Time spent starting tablet: real 0.024s	user 0.015s	sys 0.008s
I20260620 09:20:23.807595 13076 consensus_queue.cc:237] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } }
I20260620 09:20:23.812753 13077 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader 0ff5b5bd90944893875e2c3c7a7aef1e. Latest consensus state: current_term: 2 leader_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" committed_config { opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } } }
I20260620 09:20:23.812749 13078 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" committed_config { opid_index: -1 peers { permanent_uuid: "0ff5b5bd90944893875e2c3c7a7aef1e" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 35255 } } }
I20260620 09:20:23.813429 13077 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:23.813513 13078 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:23.819118 13083 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:23.819619 13083 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 09:20:23.862198  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:35255
I20260620 09:20:23.862355 13118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:35255 every 8 connection(s)
I20260620 09:20:23.869794 13119 heartbeater.cc:347] Connected to a master server at 127.9.154.254:44253
I20260620 09:20:23.869905  9835 tablet_server.cc:178] TabletServer@127.9.154.193:35255 shutting down...
I20260620 09:20:23.870265 13119 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:23.871100 13119 heartbeater.cc:511] Master 127.9.154.254:44253 requested a full tablet report, sending...
I20260620 09:20:23.874833 12793 ts_manager.cc:194] Re-registered known tserver with Master: 0ff5b5bd90944893875e2c3c7a7aef1e (127.9.154.193:35255)
W20260620 09:20:23.875432 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:23.876844 12793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49646
I20260620 09:20:23.879633 13119 heartbeater.cc:503] Master 127.9.154.254:44253 was elected leader, sending a full tablet report...
W20260620 09:20:23.882663 12793 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:23.895416  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:23.896178  9835 tablet_replica.cc:330] stopping tablet replica
I20260620 09:20:23.896725  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 2 LEADER]: Raft consensus shutting down.
I20260620 09:20:23.897112  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 0ff5b5bd90944893875e2c3c7a7aef1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:23.909444  9835 tablet_server.cc:194] TabletServer@127.9.154.193:35255 shutdown complete.
I20260620 09:20:23.924292  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:20:23.942065  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:23.943110  9835 tablet_replica.cc:330] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d: stopping tablet replica
I20260620 09:20:23.943643  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260620 09:20:23.944049  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 0c6373b37463403a9470af8b64480f2d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260620 09:20:23.963430  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:20:23.977417  9835 master.cc:537] Master@127.9.154.254:44253 shutting down...
I20260620 09:20:23.994844  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:23.995342  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:23.995638  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 16968e31b69f495b81e9cd1e5abc8a07: stopping tablet replica
I20260620 09:20:24.013875  9835 master.cc:552] Master@127.9.154.254:44253 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1267 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260620 09:20:24.039758  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:40283
I20260620 09:20:24.040805  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:24.046151 13125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:24.048195 13126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:24.049892 13128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:24.050024  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:24.050972  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:24.051226  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:24.051412  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947224051390 us; error 0 us; skew 500 ppm
I20260620 09:20:24.052068  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:24.055066  9835 webserver.cc:460] Webserver started at http://127.9.154.254:43675/ using document root <none> and password file <none>
I20260620 09:20:24.055677  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:24.055904  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:24.056210  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:24.057626  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "f677306eb4c14f90890fca0578d6af56"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.063488  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260620 09:20:24.067731 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:24.068598  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260620 09:20:24.068951  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "f677306eb4c14f90890fca0578d6af56"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.069303  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:24.105392  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:24.106729  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:24.152870  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:40283
I20260620 09:20:24.152984 13184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:40283 every 8 connection(s)
I20260620 09:20:24.157662 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:24.168260 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56: Bootstrap starting.
I20260620 09:20:24.172524 13185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:24.176343 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56: No bootstrap required, opened a new log
I20260620 09:20:24.178084 13185 raft_consensus.cc:348] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER }
I20260620 09:20:24.178522 13185 raft_consensus.cc:374] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:24.178725 13185 raft_consensus.cc:729] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f677306eb4c14f90890fca0578d6af56, State: Initialized, Role: FOLLOWER
I20260620 09:20:24.179262 13185 consensus_queue.cc:260] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER }
I20260620 09:20:24.179688 13185 raft_consensus.cc:388] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:24.179883 13185 raft_consensus.cc:482] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:24.180150 13185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:24.185935 13185 raft_consensus.cc:504] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER }
I20260620 09:20:24.187079 13185 leader_election.cc:302] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f677306eb4c14f90890fca0578d6af56; no voters: 
I20260620 09:20:24.188560 13185 leader_election.cc:288] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:24.188910 13188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:24.190646 13188 raft_consensus.cc:686] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 1 LEADER]: Becoming Leader. State: Replica: f677306eb4c14f90890fca0578d6af56, State: Running, Role: LEADER
I20260620 09:20:24.192209 13185 sys_catalog.cc:564] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:24.191704 13188 consensus_queue.cc:237] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER }
I20260620 09:20:24.196009 13189 sys_catalog.cc:455] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f677306eb4c14f90890fca0578d6af56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER } }
I20260620 09:20:24.196553 13189 sys_catalog.cc:458] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:24.197696 13190 sys_catalog.cc:455] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f677306eb4c14f90890fca0578d6af56. Latest consensus state: current_term: 1 leader_uuid: "f677306eb4c14f90890fca0578d6af56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f677306eb4c14f90890fca0578d6af56" member_type: VOTER } }
I20260620 09:20:24.198215 13190 sys_catalog.cc:458] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:24.211588 13193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:24.220654 13193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:24.226373  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:24.236553 13193 catalog_manager.cc:1347] Generated new cluster ID: 5ce3508399324423b3e0eeba51919c58
I20260620 09:20:24.236970 13193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:24.251462 13193 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:24.253432 13193 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:24.273113 13193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56: Generated new TSK 0
I20260620 09:20:24.273847 13193 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:24.293514  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:24.302138 13206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:24.302973 13207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:24.306885 13209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:24.307004  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:24.307948  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:24.308192  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:24.308378  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947224308363 us; error 0 us; skew 500 ppm
I20260620 09:20:24.308935  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:24.312124  9835 webserver.cc:460] Webserver started at http://127.9.154.193:45667/ using document root <none> and password file <none>
I20260620 09:20:24.312691  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:24.313027  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:24.313331  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:24.314483  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.319065  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 09:20:24.323073 13214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:24.323976  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260620 09:20:24.324270  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.324545  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:24.349162  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:24.350203  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:24.362401  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:24.362807  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:24.363162  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:24.363420  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:24.444389  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:42937
I20260620 09:20:24.444541 13284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:42937 every 8 connection(s)
I20260620 09:20:24.449222 13285 heartbeater.cc:347] Connected to a master server at 127.9.154.254:40283
I20260620 09:20:24.449667 13285 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:24.450678 13285 heartbeater.cc:511] Master 127.9.154.254:40283 requested a full tablet report, sending...
I20260620 09:20:24.453238 13150 ts_manager.cc:194] Registered new tserver with Master: f4b8caa2570b498ea8c8f103ddbd7b7f (127.9.154.193:42937)
I20260620 09:20:24.453836  9835 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006126993s
I20260620 09:20:24.455505 13150 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53596
I20260620 09:20:24.499552 13250 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260620 09:20:24.501195 13250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:24.516772 13295 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: Bootstrap starting.
I20260620 09:20:24.521234 13295 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:24.525281 13295 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: No bootstrap required, opened a new log
I20260620 09:20:24.525662 13295 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 09:20:24.527526 13295 raft_consensus.cc:348] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } }
I20260620 09:20:24.527912 13295 raft_consensus.cc:374] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:24.528151 13295 raft_consensus.cc:729] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4b8caa2570b498ea8c8f103ddbd7b7f, State: Initialized, Role: FOLLOWER
I20260620 09:20:24.528719 13295 consensus_queue.cc:260] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } }
I20260620 09:20:24.529150 13295 raft_consensus.cc:388] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:24.529361 13295 raft_consensus.cc:482] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:24.529904 13295 raft_consensus.cc:3037] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:24.535434 13295 raft_consensus.cc:504] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } }
I20260620 09:20:24.536012 13295 leader_election.cc:302] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4b8caa2570b498ea8c8f103ddbd7b7f; no voters: 
I20260620 09:20:24.537485 13295 leader_election.cc:288] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:24.537856 13297 raft_consensus.cc:2781] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:24.539572 13285 heartbeater.cc:503] Master 127.9.154.254:40283 was elected leader, sending a full tablet report...
I20260620 09:20:24.541708 13295 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.006s
I20260620 09:20:24.541913 13297 raft_consensus.cc:686] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 1 LEADER]: Becoming Leader. State: Replica: f4b8caa2570b498ea8c8f103ddbd7b7f, State: Running, Role: LEADER
I20260620 09:20:24.542689 13297 consensus_queue.cc:237] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } }
I20260620 09:20:24.546013 13298 tablet_replica.cc:439] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" committed_config { opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } } }
I20260620 09:20:24.546133 13299 tablet_replica.cc:439] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: TxnStatusTablet state changed. Reason: New leader f4b8caa2570b498ea8c8f103ddbd7b7f. Latest consensus state: current_term: 1 leader_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" committed_config { opid_index: -1 peers { permanent_uuid: "f4b8caa2570b498ea8c8f103ddbd7b7f" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 42937 } } }
I20260620 09:20:24.546623 13298 tablet_replica.cc:442] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:24.546684 13299 tablet_replica.cc:442] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: This TxnStatusTablet replica's current role is: LEADER
W20260620 09:20:24.550032 13150 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:24.556301 13301 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:24.556844 13301 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260620 09:20:24.558717 13150 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260620 09:20:24.613405 13237 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260620 09:20:24.613790 13237 txn_status_manager.cc:243] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260620 09:20:24.614305 13237 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260620 09:20:24.622761 13237 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260620 09:20:24.665195 13237 txn_status_manager.cc:243] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260620 09:20:24.665587 13237 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260620 09:20:24.673704 13237 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260620 09:20:24.688700 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.691144 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.693293 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.696236 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.698666 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.701578 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:55058
W20260620 09:20:24.714746 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
W20260620 09:20:24.716874 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
W20260620 09:20:24.719029 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
W20260620 09:20:24.721758 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
W20260620 09:20:24.723958 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
W20260620 09:20:24.726011 13250 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:55062
I20260620 09:20:24.731767  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:24.768891  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:24.770773  9835 tablet_replica.cc:330] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f: stopping tablet replica
I20260620 09:20:24.771425  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:24.772084  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P f4b8caa2570b498ea8c8f103ddbd7b7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:24.785643  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:24.798164  9835 master.cc:537] Master@127.9.154.254:40283 shutting down...
I20260620 09:20:24.818974  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:24.819636  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:24.820139  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P f677306eb4c14f90890fca0578d6af56: stopping tablet replica
I20260620 09:20:24.839936  9835 master.cc:552] Master@127.9.154.254:40283 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (829 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260620 09:20:24.871167  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:42313
I20260620 09:20:24.872502  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:24.878525 13310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:24.885912 13311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:24.887560  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:24.887696 13313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:24.888716  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:24.888972  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:24.889148  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947224889135 us; error 0 us; skew 500 ppm
I20260620 09:20:24.889832  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:24.892627  9835 webserver.cc:460] Webserver started at http://127.9.154.254:37363/ using document root <none> and password file <none>
I20260620 09:20:24.893247  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:24.893460  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:24.893767  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:24.895275  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "e3dfe8338d62463e9e49d4779b02c3bb"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.900923  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260620 09:20:24.905126 13318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:24.906073  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 09:20:24.906405  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "e3dfe8338d62463e9e49d4779b02c3bb"
format_stamp: "Formatted at 2026-06-20 09:20:24 on dist-test-slave-zmgx"
I20260620 09:20:24.906755  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:24.950485  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:24.951743  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:24.999887  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:42313
I20260620 09:20:25.000072 13369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:42313 every 8 connection(s)
I20260620 09:20:25.004040 13370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:25.014065 13370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb: Bootstrap starting.
I20260620 09:20:25.018059 13370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:25.022157 13370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb: No bootstrap required, opened a new log
I20260620 09:20:25.024011 13370 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER }
I20260620 09:20:25.024385 13370 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:25.024633 13370 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3dfe8338d62463e9e49d4779b02c3bb, State: Initialized, Role: FOLLOWER
I20260620 09:20:25.025203 13370 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER }
I20260620 09:20:25.025631 13370 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:25.025830 13370 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:25.026098 13370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:25.030314 13370 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER }
I20260620 09:20:25.030810 13370 leader_election.cc:302] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3dfe8338d62463e9e49d4779b02c3bb; no voters: 
I20260620 09:20:25.031980 13370 leader_election.cc:288] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:25.032367 13373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:25.033756 13373 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 1 LEADER]: Becoming Leader. State: Replica: e3dfe8338d62463e9e49d4779b02c3bb, State: Running, Role: LEADER
I20260620 09:20:25.034528 13373 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER }
I20260620 09:20:25.034797 13370 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:25.037070 13374 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER } }
I20260620 09:20:25.037554 13374 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:25.038966 13375 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3dfe8338d62463e9e49d4779b02c3bb. Latest consensus state: current_term: 1 leader_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3dfe8338d62463e9e49d4779b02c3bb" member_type: VOTER } }
I20260620 09:20:25.040235 13375 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:25.041780 13380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:25.049973 13380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:25.051082  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:25.059710 13380 catalog_manager.cc:1347] Generated new cluster ID: dd91bc976f3f420fa0eea57867d7fae6
I20260620 09:20:25.060029 13380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:25.084584 13380 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:25.086194 13380 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:25.118666 13380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb: Generated new TSK 0
I20260620 09:20:25.119426 13380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:25.181893  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:25.187451 13391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.188354 13392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:25.191640  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:25.191618 13394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:25.192694  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:25.192902  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:25.193071  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947225193057 us; error 0 us; skew 500 ppm
I20260620 09:20:25.193580  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:25.195902  9835 webserver.cc:460] Webserver started at http://127.9.154.193:46071/ using document root <none> and password file <none>
I20260620 09:20:25.196386  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:25.196600  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:25.196871  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:25.197926  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "418c66bf80894f3ebb1cbdd6551f6acb"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.202198  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260620 09:20:25.205914 13399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.206946  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 09:20:25.207258  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "418c66bf80894f3ebb1cbdd6551f6acb"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.207518  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:25.222764  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:25.223810  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:25.229741  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:25.230084  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.230386  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:25.230635  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.282150  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:37253
I20260620 09:20:25.282318 13469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:37253 every 8 connection(s)
I20260620 09:20:25.286857 13470 heartbeater.cc:347] Connected to a master server at 127.9.154.254:42313
I20260620 09:20:25.287233 13470 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:25.287984 13470 heartbeater.cc:511] Master 127.9.154.254:42313 requested a full tablet report, sending...
I20260620 09:20:25.289876 13335 ts_manager.cc:194] Registered new tserver with Master: 418c66bf80894f3ebb1cbdd6551f6acb (127.9.154.193:37253)
I20260620 09:20:25.290525  9835 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005000177s
I20260620 09:20:25.291776 13335 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40646
I20260620 09:20:25.328760 13435 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260620 09:20:25.329978 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:25.341588 13480 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: Bootstrap starting.
I20260620 09:20:25.346463 13480 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:25.350455 13480 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: No bootstrap required, opened a new log
I20260620 09:20:25.350804 13480 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: Time spent bootstrapping tablet: real 0.009s	user 0.005s	sys 0.004s
I20260620 09:20:25.352615 13480 raft_consensus.cc:348] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.353018 13480 raft_consensus.cc:374] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:25.353214 13480 raft_consensus.cc:729] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418c66bf80894f3ebb1cbdd6551f6acb, State: Initialized, Role: FOLLOWER
I20260620 09:20:25.353647 13480 consensus_queue.cc:260] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.354067 13480 raft_consensus.cc:388] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:25.354339 13480 raft_consensus.cc:482] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:25.354584 13480 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:25.359056 13480 raft_consensus.cc:504] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.359586 13480 leader_election.cc:302] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 418c66bf80894f3ebb1cbdd6551f6acb; no voters: 
I20260620 09:20:25.361004 13480 leader_election.cc:288] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:25.361208 13482 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:25.362960 13482 raft_consensus.cc:686] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 LEADER]: Becoming Leader. State: Replica: 418c66bf80894f3ebb1cbdd6551f6acb, State: Running, Role: LEADER
I20260620 09:20:25.363631 13470 heartbeater.cc:503] Master 127.9.154.254:42313 was elected leader, sending a full tablet report...
I20260620 09:20:25.364037 13480 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.006s
I20260620 09:20:25.363734 13482 consensus_queue.cc:237] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.368736 13483 tablet_replica.cc:439] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" committed_config { opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } } }
I20260620 09:20:25.369400 13483 tablet_replica.cc:442] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: This TxnStatusTablet replica's current role is: LEADER
I20260620 09:20:25.370337 13484 tablet_replica.cc:439] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: TxnStatusTablet state changed. Reason: New leader 418c66bf80894f3ebb1cbdd6551f6acb. Latest consensus state: current_term: 1 leader_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" committed_config { opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } } }
I20260620 09:20:25.371050 13484 tablet_replica.cc:442] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: This TxnStatusTablet replica's current role is: LEADER
W20260620 09:20:25.372925 13335 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:25.373502 13486 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 09:20:25.373935 13486 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260620 09:20:25.377214 13335 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260620 09:20:25.401929 13435 tablet_service.cc:1467] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260620 09:20:25.403271 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:25.413519 13480 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: Bootstrap starting.
I20260620 09:20:25.417865 13480 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:25.422014 13480 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: No bootstrap required, opened a new log
I20260620 09:20:25.422427 13480 ts_tablet_manager.cc:1397] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: Time spent bootstrapping tablet: real 0.009s	user 0.005s	sys 0.003s
I20260620 09:20:25.424292 13480 raft_consensus.cc:348] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.424721 13480 raft_consensus.cc:374] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:25.424916 13480 raft_consensus.cc:729] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418c66bf80894f3ebb1cbdd6551f6acb, State: Initialized, Role: FOLLOWER
I20260620 09:20:25.425372 13480 consensus_queue.cc:260] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.425817 13480 raft_consensus.cc:388] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:25.426009 13480 raft_consensus.cc:482] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:25.426250 13480 raft_consensus.cc:3037] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:25.430980 13480 raft_consensus.cc:504] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.431524 13480 leader_election.cc:302] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 418c66bf80894f3ebb1cbdd6551f6acb; no voters: 
I20260620 09:20:25.432013 13480 leader_election.cc:288] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:25.432192 13483 raft_consensus.cc:2781] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:25.432852 13483 raft_consensus.cc:686] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 LEADER]: Becoming Leader. State: Replica: 418c66bf80894f3ebb1cbdd6551f6acb, State: Running, Role: LEADER
I20260620 09:20:25.433534 13483 consensus_queue.cc:237] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "418c66bf80894f3ebb1cbdd6551f6acb" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 37253 } }
I20260620 09:20:25.434165 13480 ts_tablet_manager.cc:1428] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
W20260620 09:20:25.438659 13335 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260620 09:20:25.442842 13335 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260620 09:20:25.464174  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:25.484398  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:25.485248  9835 tablet_replica.cc:330] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb: stopping tablet replica
I20260620 09:20:25.485813  9835 raft_consensus.cc:2229] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:25.486397  9835 raft_consensus.cc:2258] T 22222222222222222222222222222222 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:25.489034  9835 tablet_replica.cc:330] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb: stopping tablet replica
I20260620 09:20:25.489549  9835 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:25.489985  9835 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 418c66bf80894f3ebb1cbdd6551f6acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:25.512234  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:25.523799  9835 master.cc:537] Master@127.9.154.254:42313 shutting down...
I20260620 09:20:25.537068  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:25.537583  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:25.538019  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P e3dfe8338d62463e9e49d4779b02c3bb: stopping tablet replica
I20260620 09:20:25.555990  9835 master.cc:552] Master@127.9.154.254:42313 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (709 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3723 ms total)

[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN      ] FailedTabletsAreReplacedITest.OneReplica/0
I20260620 09:20:25.578441  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:39259
I20260620 09:20:25.579452  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:25.584630 13496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.585292 13497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.588346 13499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:25.589284  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:25.590020  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:25.590198  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:25.590449  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947225590437 us; error 0 us; skew 500 ppm
I20260620 09:20:25.591032  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:25.597244  9835 webserver.cc:460] Webserver started at http://127.9.154.254:43083/ using document root <none> and password file <none>
I20260620 09:20:25.597740  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:25.597930  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:25.598162  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:25.599403  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "7f6dbd27f3974c21a3ca0fdc6983452b"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.604063  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 09:20:25.607621 13504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.608403  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260620 09:20:25.608731  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "7f6dbd27f3974c21a3ca0fdc6983452b"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.609040  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:25.631899  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:25.632969  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:25.669546  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:39259
I20260620 09:20:25.669708 13555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:39259 every 8 connection(s)
I20260620 09:20:25.673220 13556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:25.683640 13556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b: Bootstrap starting.
I20260620 09:20:25.688259 13556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:25.692540 13556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b: No bootstrap required, opened a new log
I20260620 09:20:25.694373 13556 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER }
I20260620 09:20:25.694728 13556 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:25.694967 13556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6dbd27f3974c21a3ca0fdc6983452b, State: Initialized, Role: FOLLOWER
I20260620 09:20:25.695533 13556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER }
I20260620 09:20:25.695971 13556 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:25.696177 13556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:25.696437 13556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:25.700765 13556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER }
I20260620 09:20:25.701262 13556 leader_election.cc:302] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f6dbd27f3974c21a3ca0fdc6983452b; no voters: 
I20260620 09:20:25.702369 13556 leader_election.cc:288] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:25.702703 13559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:25.703953 13559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 1 LEADER]: Becoming Leader. State: Replica: 7f6dbd27f3974c21a3ca0fdc6983452b, State: Running, Role: LEADER
I20260620 09:20:25.704589 13559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER }
I20260620 09:20:25.705161 13556 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:25.707258 13561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f6dbd27f3974c21a3ca0fdc6983452b. Latest consensus state: current_term: 1 leader_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER } }
I20260620 09:20:25.707230 13560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6dbd27f3974c21a3ca0fdc6983452b" member_type: VOTER } }
I20260620 09:20:25.707924 13561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:25.708009 13560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:25.711833 13564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:25.720150 13564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:25.721374  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:25.729404 13564 catalog_manager.cc:1347] Generated new cluster ID: c23460390417415fb19a09f2ab151a3d
I20260620 09:20:25.729691 13564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:25.753320 13564 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:25.754984 13564 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:25.775449 13564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b: Generated new TSK 0
I20260620 09:20:25.776074 13564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:25.788687  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:25.795284 13577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.796449 13578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.797963 13580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:25.798906  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:25.799782  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:25.799952  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:25.800165  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947225800153 us; error 0 us; skew 500 ppm
I20260620 09:20:25.800765  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:25.803411  9835 webserver.cc:460] Webserver started at http://127.9.154.193:41487/ using document root <none> and password file <none>
I20260620 09:20:25.803879  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:25.804036  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:25.804342  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:25.805418  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "0a63d84edb2b4a16ab1378a6c79e9a84"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.810135  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260620 09:20:25.814294 13585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.815287  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 09:20:25.815608  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "0a63d84edb2b4a16ab1378a6c79e9a84"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.815877  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:25.834468  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:25.835480  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:25.837102  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:25.839586  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:25.839814  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.840083  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:25.840265  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.882365  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:45661
I20260620 09:20:25.882443 13647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:45661 every 8 connection(s)
I20260620 09:20:25.888321  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:25.895342 13652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.897289 13653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.898955 13655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:25.899025  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:25.900470  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:25.900764  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:25.900945  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947225900936 us; error 0 us; skew 500 ppm
I20260620 09:20:25.901552  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:25.903920 13648 heartbeater.cc:347] Connected to a master server at 127.9.154.254:39259
I20260620 09:20:25.904313 13648 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:25.904707  9835 webserver.cc:460] Webserver started at http://127.9.154.194:40041/ using document root <none> and password file <none>
I20260620 09:20:25.905161 13648 heartbeater.cc:511] Master 127.9.154.254:39259 requested a full tablet report, sending...
I20260620 09:20:25.905265  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:25.905601  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:25.905952  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:25.907701 13521 ts_manager.cc:194] Registered new tserver with Master: 0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661)
I20260620 09:20:25.907693  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "12b04ccd052a4d118af5f5d8cf6a43ae"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.910080 13521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47456
I20260620 09:20:25.914734  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260620 09:20:25.918515 13660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.919394  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260620 09:20:25.919641  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "12b04ccd052a4d118af5f5d8cf6a43ae"
format_stamp: "Formatted at 2026-06-20 09:20:25 on dist-test-slave-zmgx"
I20260620 09:20:25.919893  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:25.936370  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:25.937531  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:25.938880  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:25.941061  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:25.941231  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.941495  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:25.941636  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:25.983078  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:38455
I20260620 09:20:25.983186 13722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:38455 every 8 connection(s)
I20260620 09:20:25.987800  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:25.995839 13726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:25.998812 13727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:26.000252 13729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:26.002100 13723 heartbeater.cc:347] Connected to a master server at 127.9.154.254:39259
I20260620 09:20:26.002533 13723 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:26.003543  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:26.003480 13723 heartbeater.cc:511] Master 127.9.154.254:39259 requested a full tablet report, sending...
I20260620 09:20:26.004576  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:26.004904  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:26.005148  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947226005129 us; error 0 us; skew 500 ppm
I20260620 09:20:26.005985  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:26.006443 13521 ts_manager.cc:194] Registered new tserver with Master: 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455)
I20260620 09:20:26.009060 13521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47466
I20260620 09:20:26.009105  9835 webserver.cc:460] Webserver started at http://127.9.154.195:45663/ using document root <none> and password file <none>
I20260620 09:20:26.010041  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:26.010366  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:26.010705  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:26.012491  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-2-root/instance:
uuid: "cd44d08dabd04b819db1487a39ebf9a1"
format_stamp: "Formatted at 2026-06-20 09:20:26 on dist-test-slave-zmgx"
I20260620 09:20:26.018282  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.006s
I20260620 09:20:26.022437 13734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:26.023633  9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260620 09:20:26.023950  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-2-root
uuid: "cd44d08dabd04b819db1487a39ebf9a1"
format_stamp: "Formatted at 2026-06-20 09:20:26 on dist-test-slave-zmgx"
I20260620 09:20:26.024243  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:26.053576  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:26.054783  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:26.056234  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:26.058449  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:26.058686  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:26.058938  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:26.059108  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:26.105836  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.195:42821
I20260620 09:20:26.105980 13796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.195:42821 every 8 connection(s)
I20260620 09:20:26.122325 13797 heartbeater.cc:347] Connected to a master server at 127.9.154.254:39259
I20260620 09:20:26.122736 13797 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:26.123380 13797 heartbeater.cc:511] Master 127.9.154.254:39259 requested a full tablet report, sending...
I20260620 09:20:26.125547 13521 ts_manager.cc:194] Registered new tserver with Master: cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821)
I20260620 09:20:26.126332  9835 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017205477s
I20260620 09:20:26.127978 13521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47476
I20260620 09:20:26.149657  9835 test_util.cc:268] Using random seed: -345222398
I20260620 09:20:26.175282 13521 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47496:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260620 09:20:26.224481 13762 tablet_service.cc:1467] Processing CreateTablet for tablet 66a1c461927047f59451405e602e7df0 (DEFAULT_TABLE table=test-workload [id=ac5ff28240444032935376a7198b8e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:26.225627 13762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a1c461927047f59451405e602e7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:26.234580 13613 tablet_service.cc:1467] Processing CreateTablet for tablet 66a1c461927047f59451405e602e7df0 (DEFAULT_TABLE table=test-workload [id=ac5ff28240444032935376a7198b8e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:26.235582 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a1c461927047f59451405e602e7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:26.240504 13817 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: Bootstrap starting.
I20260620 09:20:26.241834 13688 tablet_service.cc:1467] Processing CreateTablet for tablet 66a1c461927047f59451405e602e7df0 (DEFAULT_TABLE table=test-workload [id=ac5ff28240444032935376a7198b8e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:26.242904 13688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a1c461927047f59451405e602e7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:26.247287 13817 tablet_bootstrap.cc:654] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:26.251972 13819 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Bootstrap starting.
I20260620 09:20:26.252359 13817 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: No bootstrap required, opened a new log
I20260620 09:20:26.252825 13817 ts_tablet_manager.cc:1397] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260620 09:20:26.255439 13817 raft_consensus.cc:348] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.256453 13817 raft_consensus.cc:374] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:26.256839 13817 raft_consensus.cc:729] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd44d08dabd04b819db1487a39ebf9a1, State: Initialized, Role: FOLLOWER
I20260620 09:20:26.258276 13819 tablet_bootstrap.cc:654] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:26.257740 13817 consensus_queue.cc:260] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.259414 13820 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Bootstrap starting.
I20260620 09:20:26.263149 13817 ts_tablet_manager.cc:1428] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260620 09:20:26.263886 13797 heartbeater.cc:503] Master 127.9.154.254:39259 was elected leader, sending a full tablet report...
I20260620 09:20:26.264150 13819 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: No bootstrap required, opened a new log
I20260620 09:20:26.264654 13819 ts_tablet_manager.cc:1397] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260620 09:20:26.266788 13820 tablet_bootstrap.cc:654] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:26.268543 13819 raft_consensus.cc:348] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.269385 13819 raft_consensus.cc:374] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:26.269721 13819 raft_consensus.cc:729] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a63d84edb2b4a16ab1378a6c79e9a84, State: Initialized, Role: FOLLOWER
I20260620 09:20:26.270624 13819 consensus_queue.cc:260] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.272789 13820 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: No bootstrap required, opened a new log
I20260620 09:20:26.273068 13648 heartbeater.cc:503] Master 127.9.154.254:39259 was elected leader, sending a full tablet report...
I20260620 09:20:26.273315 13820 ts_tablet_manager.cc:1397] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.002s
I20260620 09:20:26.273505 13819 ts_tablet_manager.cc:1428] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260620 09:20:26.276031 13820 raft_consensus.cc:348] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.276651 13820 raft_consensus.cc:374] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:26.276880 13820 raft_consensus.cc:729] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b04ccd052a4d118af5f5d8cf6a43ae, State: Initialized, Role: FOLLOWER
I20260620 09:20:26.277887 13820 consensus_queue.cc:260] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.280586 13723 heartbeater.cc:503] Master 127.9.154.254:39259 was elected leader, sending a full tablet report...
I20260620 09:20:26.280997 13820 ts_tablet_manager.cc:1428] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260620 09:20:26.282161 13824 raft_consensus.cc:482] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:26.282684 13824 raft_consensus.cc:504] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.285121 13824 leader_election.cc:288] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821), 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455)
I20260620 09:20:26.299010 13772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66a1c461927047f59451405e602e7df0" candidate_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd44d08dabd04b819db1487a39ebf9a1" is_pre_election: true
I20260620 09:20:26.299780 13772 raft_consensus.cc:2454] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a63d84edb2b4a16ab1378a6c79e9a84 in term 0.
I20260620 09:20:26.300962 13588 leader_election.cc:302] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a63d84edb2b4a16ab1378a6c79e9a84, cd44d08dabd04b819db1487a39ebf9a1; no voters: 
I20260620 09:20:26.301106 13698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66a1c461927047f59451405e602e7df0" candidate_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" is_pre_election: true
I20260620 09:20:26.301931 13824 raft_consensus.cc:2781] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:20:26.302336 13824 raft_consensus.cc:482] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:20:26.302567 13824 raft_consensus.cc:3037] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:26.301857 13698 raft_consensus.cc:2454] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a63d84edb2b4a16ab1378a6c79e9a84 in term 0.
I20260620 09:20:26.307305 13824 raft_consensus.cc:504] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.308808 13824 leader_election.cc:288] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [CANDIDATE]: Term 1 election: Requested vote from peers cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821), 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455)
I20260620 09:20:26.309660 13772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66a1c461927047f59451405e602e7df0" candidate_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd44d08dabd04b819db1487a39ebf9a1"
I20260620 09:20:26.309897 13698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66a1c461927047f59451405e602e7df0" candidate_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae"
I20260620 09:20:26.310566 13698 raft_consensus.cc:3037] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:26.310137 13772 raft_consensus.cc:3037] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:26.316009 13698 raft_consensus.cc:2454] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a63d84edb2b4a16ab1378a6c79e9a84 in term 1.
I20260620 09:20:26.317180 13588 leader_election.cc:302] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a63d84edb2b4a16ab1378a6c79e9a84, 12b04ccd052a4d118af5f5d8cf6a43ae; no voters: 
I20260620 09:20:26.317972 13824 raft_consensus.cc:2781] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:26.318984 13824 raft_consensus.cc:686] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Becoming Leader. State: Replica: 0a63d84edb2b4a16ab1378a6c79e9a84, State: Running, Role: LEADER
I20260620 09:20:26.319653 13772 raft_consensus.cc:2454] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a63d84edb2b4a16ab1378a6c79e9a84 in term 1.
I20260620 09:20:26.319774 13824 consensus_queue.cc:237] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:26.326690 13519 catalog_manager.cc:5495] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193). New cstate: current_term: 1 leader_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:26.599035 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:26.599052 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:26.600841 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:26.810036 13824 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
I20260620 09:20:26.823503 13824 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 66a1c461927047f59451405e602e7df0 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661): RUNNING [LEADER]
  cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821): RUNNING
  12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): RUNNING
All reported replicas are:
  A = 0a63d84edb2b4a16ab1378a6c79e9a84
  B = cd44d08dabd04b819db1487a39ebf9a1
  C = 12b04ccd052a4d118af5f5d8cf6a43ae
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A*  B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:26.834280  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:27.202708 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:27.205760 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:27.205766 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260620 09:20:27.392881  9835 log_verifier.cc:126] Checking tablet 66a1c461927047f59451405e602e7df0
I20260620 09:20:27.454169  9835 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 66a1c461927047f59451405e602e7df0
I20260620 09:20:27.454758  9835 tablet_replica.cc:330] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: stopping tablet replica
I20260620 09:20:27.455245  9835 raft_consensus.cc:2229] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:27.455689  9835 raft_consensus.cc:2258] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:27.667874 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:27.670286 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:27.670495 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260620 09:20:27.819447 13588 consensus_peers.cc:487] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 -> Peer 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): Couldn't send request to peer 12b04ccd052a4d118af5f5d8cf6a43ae. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:27.820916 13824 raft_consensus.cc:998] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Attempting to remove follower 12b04ccd052a4d118af5f5d8cf6a43ae from the Raft config. Reason: The tablet replica hosted on peer 12b04ccd052a4d118af5f5d8cf6a43ae has failed
I20260620 09:20:27.823084 13824 consensus_queue.cc:237] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } }
I20260620 09:20:27.836015 13772 raft_consensus.cc:1261] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Refusing update from remote peer 0a63d84edb2b4a16ab1378a6c79e9a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 09:20:27.837325 13824 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:20:27.842792 13912 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
I20260620 09:20:27.844480 13772 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
I20260620 09:20:27.859292 13519 catalog_manager.cc:5495] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 reported cstate change: config changed from index -1 to 2, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New cstate: current_term: 1 leader_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
I20260620 09:20:27.874096 13688 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a1c461927047f59451405e602e7df0 with delete_type TABLET_DATA_TOMBSTONED (TS 12b04ccd052a4d118af5f5d8cf6a43ae not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:50016
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 66a1c461927047f59451405e602e7df0 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
  0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661): RUNNING [LEADER]
  cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821): RUNNING
  12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): not running
I20260620 09:20:27.877545 13623 consensus_queue.cc:237] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
    State:       FAILED
    Data state:  TABLET_DATA_READY
    Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
  A = 0a63d84edb2b4a16ab1378a6c79e9a84
  B = cd44d08dabd04b819db1487a39ebf9a1
  C = 12b04ccd052a4d118af5f5d8cf6a43ae
The consensus matrix is:
 Config source |        Replicas        | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
 master        | A*  B   C              |              |              | Yes
 A             | A*  B   C              | 1            | -1           | Yes
 B             | A*  B   C              | 1            | -1           | Yes
 C             | [config not available] |              |              | 

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |      Status      | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | UNDER_REPLICATED | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
W20260620 09:20:27.882961 13588 consensus_peers.cc:487] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 -> Peer 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): Couldn't send request to peer 12b04ccd052a4d118af5f5d8cf6a43ae. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:27.883446 13772 raft_consensus.cc:1261] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Refusing update from remote peer 0a63d84edb2b4a16ab1378a6c79e9a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 09:20:27.884537 13915 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:20:27.887814  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:27.891222 13912 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:27.893584 13920 ts_tablet_manager.cc:1905] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 09:20:27.892769 13772 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:27.898713 13506 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:VOTER RPC for tablet 66a1c461927047f59451405e602e7df0 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260620 09:20:27.902730 13519 catalog_manager.cc:5495] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 reported cstate change: config changed from index 2 to 3, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New cstate: current_term: 1 leader_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:27.906639 13920 ts_tablet_manager.cc:1918] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260620 09:20:27.907055 13920 log.cc:1196] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1781947168426282-9835-0/minicluster-data/ts-1-root/wals/66a1c461927047f59451405e602e7df0
I20260620 09:20:27.908401 13507 catalog_manager.cc:4841] TS 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): tablet 66a1c461927047f59451405e602e7df0 (table test-workload [id=ac5ff28240444032935376a7198b8e27]) successfully deleted
I20260620 09:20:28.261058 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:28.262333 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:28.264086 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:28.436442 13947 raft_consensus.cc:998] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Attempting to remove follower 12b04ccd052a4d118af5f5d8cf6a43ae from the Raft config. Reason: The tablet replica hosted on peer 12b04ccd052a4d118af5f5d8cf6a43ae has failed
I20260620 09:20:28.438278 13947 consensus_queue.cc:237] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } }
I20260620 09:20:28.443143 13772 raft_consensus.cc:1261] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Refusing update from remote peer 0a63d84edb2b4a16ab1378a6c79e9a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 09:20:28.444424 13949 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 09:20:28.449605 13947 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
I20260620 09:20:28.450795 13772 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 66a1c461927047f59451405e602e7df0 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
  0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661): RUNNING [LEADER]
  cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821): RUNNING
  12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): not running
    State:       FAILED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Deleted tablet blocks from disk
All reported replicas are:
  A = 0a63d84edb2b4a16ab1378a6c79e9a84
  B = cd44d08dabd04b819db1487a39ebf9a1
  C = 12b04ccd052a4d118af5f5d8cf6a43ae
The consensus matrix is:
 Config source |        Replicas        | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
 master        | A*  B   C              |              |              | Yes
 A             | A*  B   C              | 1            | 3            | Yes
 B             | A*  B   C              | 1            | 3            | Yes
 C             | [config not available] |              |              | 

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |      Status      | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | UNDER_REPLICATED | 1             | 0       | 0          | 1                | 0

I20260620 09:20:28.461621 13519 catalog_manager.cc:5495] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 reported cstate change: config changed from index 3 to 4, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) evicted. New cstate: current_term: 1 leader_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } }
Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:28.467221  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:28.475225 13688 tablet_service.cc:1514] Processing DeleteTablet for tablet 66a1c461927047f59451405e602e7df0 with delete_type TABLET_DATA_TOMBSTONED (TS 12b04ccd052a4d118af5f5d8cf6a43ae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50016
I20260620 09:20:28.477530 13623 consensus_queue.cc:237] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:28.481573 13507 catalog_manager.cc:4841] TS 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): tablet 66a1c461927047f59451405e602e7df0 (table test-workload [id=ac5ff28240444032935376a7198b8e27]) successfully deleted
I20260620 09:20:28.482719 13772 raft_consensus.cc:1261] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Refusing update from remote peer 0a63d84edb2b4a16ab1378a6c79e9a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260620 09:20:28.482795 13588 consensus_peers.cc:487] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 -> Peer 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): Couldn't send request to peer 12b04ccd052a4d118af5f5d8cf6a43ae. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:28.483918 13947 consensus_queue.cc:1035] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 09:20:28.489599 13949 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:28.491321 13772 raft_consensus.cc:2932] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:28.496352 13506 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:VOTER RPC for tablet 66a1c461927047f59451405e602e7df0 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260620 09:20:28.499457 13519 catalog_manager.cc:5495] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 reported cstate change: config changed from index 4 to 5, VOTER 12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194) added. New cstate: current_term: 1 leader_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } } }
I20260620 09:20:28.863566 13973 ts_tablet_manager.cc:927] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Initiating tablet copy from peer 0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661)
I20260620 09:20:28.866214 13973 tablet_copy_client.cc:316] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet copy: Beginning tablet copy session from remote peer at address 127.9.154.193:45661
I20260620 09:20:28.881615 13633 tablet_copy_service.cc:140] P 0a63d84edb2b4a16ab1378a6c79e9a84: Received BeginTabletCopySession request for tablet 66a1c461927047f59451405e602e7df0 from peer 12b04ccd052a4d118af5f5d8cf6a43ae ({username='slave'} at 127.0.0.1:48276)
I20260620 09:20:28.882162 13633 tablet_copy_service.cc:161] P 0a63d84edb2b4a16ab1378a6c79e9a84: Beginning new tablet copy session on tablet 66a1c461927047f59451405e602e7df0 from peer 12b04ccd052a4d118af5f5d8cf6a43ae at {username='slave'} at 127.0.0.1:48276: session id = 12b04ccd052a4d118af5f5d8cf6a43ae-66a1c461927047f59451405e602e7df0
I20260620 09:20:28.888118 13633 tablet_copy_source_session.cc:205] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 09:20:28.890559 13973 ts_tablet_manager.cc:1905] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260620 09:20:28.913854 13973 ts_tablet_manager.cc:1918] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260620 09:20:28.915117 13973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66a1c461927047f59451405e602e7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:28.923871 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:28.925529 13973 tablet_copy_client.cc:791] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet copy: Starting download of 0 data blocks...
I20260620 09:20:28.926182 13973 tablet_copy_client.cc:655] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet copy: Starting download of 1 WAL segments...
I20260620 09:20:28.932837 13973 tablet_copy_client.cc:531] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 09:20:28.944325 13973 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Bootstrap starting.
I20260620 09:20:28.980535 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:28.994552 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:29.015568 13973 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:20:29.016891 13973 tablet_bootstrap.cc:492] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Bootstrap complete.
I20260620 09:20:29.018364 13973 ts_tablet_manager.cc:1397] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.018s
I20260620 09:20:29.022786 13973 raft_consensus.cc:348] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:29.024228 13973 raft_consensus.cc:729] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b04ccd052a4d118af5f5d8cf6a43ae, State: Initialized, Role: FOLLOWER
I20260620 09:20:29.025038 13973 consensus_queue.cc:260] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0a63d84edb2b4a16ab1378a6c79e9a84" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 45661 } } peers { permanent_uuid: "cd44d08dabd04b819db1487a39ebf9a1" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 42821 } } peers { permanent_uuid: "12b04ccd052a4d118af5f5d8cf6a43ae" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38455 } }
I20260620 09:20:29.028101 13973 ts_tablet_manager.cc:1428] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.008s
I20260620 09:20:29.031437 13633 tablet_copy_service.cc:342] P 0a63d84edb2b4a16ab1378a6c79e9a84: Request end of tablet copy session 12b04ccd052a4d118af5f5d8cf6a43ae-66a1c461927047f59451405e602e7df0 received from {username='slave'} at 127.0.0.1:48276
I20260620 09:20:29.032083 13633 tablet_copy_service.cc:433] P 0a63d84edb2b4a16ab1378a6c79e9a84: ending tablet copy session 12b04ccd052a4d118af5f5d8cf6a43ae-66a1c461927047f59451405e602e7df0 on tablet 66a1c461927047f59451405e602e7df0 with peer 12b04ccd052a4d118af5f5d8cf6a43ae
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 66a1c461927047f59451405e602e7df0 of table 'test-workload' is recovering: 1 on-going tablet copies
  0a63d84edb2b4a16ab1378a6c79e9a84 (127.9.154.193:45661): RUNNING [LEADER]
  cd44d08dabd04b819db1487a39ebf9a1 (127.9.154.195:42821): RUNNING
  12b04ccd052a4d118af5f5d8cf6a43ae (127.9.154.194:38455): not running
    State:       INITIALIZED
    Data state:  TABLET_DATA_COPYING
    Last status: Tablet Copy: Replacing tablet superblock
All reported replicas are:
  A = 0a63d84edb2b4a16ab1378a6c79e9a84
  B = cd44d08dabd04b819db1487a39ebf9a1
  C = 12b04ccd052a4d118af5f5d8cf6a43ae
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A*  B   C    | 1            | 5            | Yes
 B             | A*  B   C    | 1            | 5            | Yes
 C             | A   B   C    | 1            | 5            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |   Status   | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | RECOVERING | 1             | 0       | 1          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:29.220613  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:29.394623 13698 raft_consensus.cc:1203] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5]   Dedup: 1.5->[]
I20260620 09:20:29.792420 13613 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:29.793200 13762 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:29.794250 13688 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 7f6dbd27f3974c21a3ca0fdc6983452b | 127.9.154.254:39259 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 0a63d84edb2b4a16ab1378a6c79e9a84 | 127.9.154.193:45661 | HEALTHY | <none>   |       1        |       0
 12b04ccd052a4d118af5f5d8cf6a43ae | 127.9.154.194:38455 | HEALTHY | <none>   |       0        |       0
 cd44d08dabd04b819db1487a39ebf9a1 | 127.9.154.195:42821 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260620 09:20:29.997956  9835 log_verifier.cc:126] Checking tablet 66a1c461927047f59451405e602e7df0
I20260620 09:20:30.065810  9835 log_verifier.cc:177] Verified matching terms for 5 ops in tablet 66a1c461927047f59451405e602e7df0
I20260620 09:20:30.069859  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:30.097528  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:30.098295  9835 tablet_replica.cc:330] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84: stopping tablet replica
I20260620 09:20:30.098873  9835 raft_consensus.cc:2229] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:30.099754  9835 raft_consensus.cc:2258] T 66a1c461927047f59451405e602e7df0 P 0a63d84edb2b4a16ab1378a6c79e9a84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:30.122612  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:30.134567  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:20:30.162309  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:30.162998  9835 tablet_replica.cc:330] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae: stopping tablet replica
I20260620 09:20:30.163514  9835 raft_consensus.cc:2229] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:30.163844  9835 raft_consensus.cc:2258] T 66a1c461927047f59451405e602e7df0 P 12b04ccd052a4d118af5f5d8cf6a43ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:30.184944  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:20:30.197317  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:20:30.231382  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:30.232035  9835 tablet_replica.cc:330] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1: stopping tablet replica
I20260620 09:20:30.232604  9835 raft_consensus.cc:2229] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:30.233208  9835 raft_consensus.cc:2258] T 66a1c461927047f59451405e602e7df0 P cd44d08dabd04b819db1487a39ebf9a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:30.254174  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:20:30.263763  9835 master.cc:537] Master@127.9.154.254:39259 shutting down...
I20260620 09:20:30.281265  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:30.281822  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:30.282182  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7f6dbd27f3974c21a3ca0fdc6983452b: stopping tablet replica
I20260620 09:20:30.300444  9835 master.cc:552] Master@127.9.154.254:39259 shutdown complete.
[       OK ] FailedTabletsAreReplacedITest.OneReplica/0 (4751 ms)
[ RUN      ] FailedTabletsAreReplacedITest.OneReplica/1
I20260620 09:20:30.329999  9835 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.154.254:43339
I20260620 09:20:30.331061  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:30.336465 14018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.337132 14019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.345018  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:30.345057 14021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.345968  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:30.346169  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:30.346378  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947230346363 us; error 0 us; skew 500 ppm
I20260620 09:20:30.346872  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:30.349174  9835 webserver.cc:460] Webserver started at http://127.9.154.254:45073/ using document root <none> and password file <none>
I20260620 09:20:30.349627  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:30.349817  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:30.350075  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:30.351223  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/master-0-root/instance:
uuid: "a0550acbba7a405db79c3174d35c4cf8"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.355520  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 09:20:30.358753 14026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.359666  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:20:30.359915  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/master-0-root
uuid: "a0550acbba7a405db79c3174d35c4cf8"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.360162  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:30.376734  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:30.377900  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:30.418670  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.254:43339
I20260620 09:20:30.418785 14077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.254:43339 every 8 connection(s)
I20260620 09:20:30.422732 14078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:30.433502 14078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8: Bootstrap starting.
I20260620 09:20:30.437906 14078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:30.441883 14078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8: No bootstrap required, opened a new log
I20260620 09:20:30.443892 14078 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER }
I20260620 09:20:30.444272 14078 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:30.444494 14078 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0550acbba7a405db79c3174d35c4cf8, State: Initialized, Role: FOLLOWER
I20260620 09:20:30.445098 14078 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER }
I20260620 09:20:30.445513 14078 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 09:20:30.445716 14078 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 09:20:30.445988 14078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:30.450068 14078 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER }
I20260620 09:20:30.450539 14078 leader_election.cc:302] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0550acbba7a405db79c3174d35c4cf8; no voters: 
I20260620 09:20:30.451658 14078 leader_election.cc:288] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 09:20:30.452181 14081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:30.453459 14081 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 1 LEADER]: Becoming Leader. State: Replica: a0550acbba7a405db79c3174d35c4cf8, State: Running, Role: LEADER
I20260620 09:20:30.454087 14081 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER }
I20260620 09:20:30.454440 14078 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 09:20:30.457020 14082 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0550acbba7a405db79c3174d35c4cf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER } }
I20260620 09:20:30.457052 14083 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0550acbba7a405db79c3174d35c4cf8. Latest consensus state: current_term: 1 leader_uuid: "a0550acbba7a405db79c3174d35c4cf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0550acbba7a405db79c3174d35c4cf8" member_type: VOTER } }
I20260620 09:20:30.457690 14082 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:30.457706 14083 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [sys.catalog]: This master's current role is: LEADER
I20260620 09:20:30.460860 14086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 09:20:30.468914 14086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 09:20:30.470453  9835 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 09:20:30.477363 14086 catalog_manager.cc:1347] Generated new cluster ID: 7127ce6a6f8342fdb6ab20e2fdcce62d
I20260620 09:20:30.477638 14086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 09:20:30.494659 14086 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 09:20:30.496412 14086 catalog_manager.cc:1504] Loading token signing keys...
I20260620 09:20:30.508107 14086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8: Generated new TSK 0
I20260620 09:20:30.508821 14086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 09:20:30.537004  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:30.543123 14099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.544579 14100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.546813 14102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.546870  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:30.547982  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:30.548208  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:30.548398  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947230548382 us; error 0 us; skew 500 ppm
I20260620 09:20:30.548982  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:30.551409  9835 webserver.cc:460] Webserver started at http://127.9.154.193:36141/ using document root <none> and password file <none>
I20260620 09:20:30.551913  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:30.552116  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:30.552417  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:30.553557  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root/instance:
uuid: "7f8847a2f61c4db68bd72fe139fdecb8"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.558027  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 09:20:30.561391 14107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.562325  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 09:20:30.562633  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root
uuid: "7f8847a2f61c4db68bd72fe139fdecb8"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.562896  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:30.584030  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:30.585192  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:30.586807  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:30.588989  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:30.589154  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.589435  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:30.589565  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.633519  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.193:34401
I20260620 09:20:30.633595 14169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.193:34401 every 8 connection(s)
I20260620 09:20:30.638482  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:30.645437 14174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.646409 14175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.648497 14177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.649555  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:30.650308  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:30.650535  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:30.650693  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947230650682 us; error 0 us; skew 500 ppm
I20260620 09:20:30.651197  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:30.656435  9835 webserver.cc:460] Webserver started at http://127.9.154.194:46237/ using document root <none> and password file <none>
I20260620 09:20:30.657029  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:30.657267  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:30.657531  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:30.658047 14170 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43339
I20260620 09:20:30.658468 14170 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:30.658798  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-1-root/instance:
uuid: "d9155372c4394cee81370c63c8920f9a"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.659191 14170 heartbeater.cc:511] Master 127.9.154.254:43339 requested a full tablet report, sending...
I20260620 09:20:30.661254 14043 ts_manager.cc:194] Registered new tserver with Master: 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401)
I20260620 09:20:30.663551  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 09:20:30.663695 14043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60154
I20260620 09:20:30.667209 14182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.668026  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 09:20:30.668264  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-1-root
uuid: "d9155372c4394cee81370c63c8920f9a"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.668485  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:30.679015  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:30.680058  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:30.681437  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:30.683549  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:30.683712  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.683970  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:30.684122  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.721431  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.194:38343
I20260620 09:20:30.721532 14244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.194:38343 every 8 connection(s)
I20260620 09:20:30.725975  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:30.734069 14248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.734942 14249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.739393 14251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.740255 14245 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43339
I20260620 09:20:30.740355  9835 server_base.cc:1034] running on GCE node
I20260620 09:20:30.740819 14245 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:30.741433  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:30.741725  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:30.741675 14245 heartbeater.cc:511] Master 127.9.154.254:43339 requested a full tablet report, sending...
I20260620 09:20:30.742057  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947230742043 us; error 0 us; skew 500 ppm
I20260620 09:20:30.742796  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:30.744423 14043 ts_manager.cc:194] Registered new tserver with Master: d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343)
I20260620 09:20:30.745473  9835 webserver.cc:460] Webserver started at http://127.9.154.195:38445/ using document root <none> and password file <none>
I20260620 09:20:30.745945  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:30.746132  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:30.746273 14043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60170
I20260620 09:20:30.746450  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:30.747885  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-2-root/instance:
uuid: "bad97c22888a4f0abb9b4cbedb064154"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.752444  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260620 09:20:30.755513 14256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.756398  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 09:20:30.756714  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-2-root
uuid: "bad97c22888a4f0abb9b4cbedb064154"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.757027  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:30.790843  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:30.792107  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:30.793541  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:30.795686  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:30.795897  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.796144  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:30.796306  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.837728  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.195:41007
I20260620 09:20:30.837811 14318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.195:41007 every 8 connection(s)
I20260620 09:20:30.842901  9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 09:20:30.850317 14322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 09:20:30.852699 14323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.854525  9835 server_base.cc:1034] running on GCE node
W20260620 09:20:30.855370 14325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 09:20:30.856609  9835 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 09:20:30.856993  9835 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 09:20:30.857352  9835 hybrid_clock.cc:648] HybridClock initialized: now 1781947230857333 us; error 0 us; skew 500 ppm
I20260620 09:20:30.858119  9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 09:20:30.859135 14319 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43339
I20260620 09:20:30.859526 14319 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:30.860289 14319 heartbeater.cc:511] Master 127.9.154.254:43339 requested a full tablet report, sending...
I20260620 09:20:30.861080  9835 webserver.cc:460] Webserver started at http://127.9.154.196:44873/ using document root <none> and password file <none>
I20260620 09:20:30.861593  9835 fs_manager.cc:359] Metadata directory not provided
I20260620 09:20:30.861856  9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 09:20:30.862139  9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 09:20:30.862185 14043 ts_manager.cc:194] Registered new tserver with Master: bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195:41007)
I20260620 09:20:30.863725  9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-3-root/instance:
uuid: "e211023b756747b8a759d831fe62121b"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.863895 14043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60184
I20260620 09:20:30.868507  9835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 09:20:30.872032 14330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.872877  9835 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260620 09:20:30.873204  9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-3-root
uuid: "e211023b756747b8a759d831fe62121b"
format_stamp: "Formatted at 2026-06-20 09:20:30 on dist-test-slave-zmgx"
I20260620 09:20:30.873492  9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 09:20:30.885003  9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 09:20:30.886111  9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 09:20:30.887722  9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 09:20:30.889819  9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 09:20:30.889984  9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.890280  9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 09:20:30.890413  9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 09:20:30.931104  9835 rpc_server.cc:307] RPC server started. Bound to: 127.9.154.196:37411
I20260620 09:20:30.931192 14392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.154.196:37411 every 8 connection(s)
I20260620 09:20:30.947835 14393 heartbeater.cc:347] Connected to a master server at 127.9.154.254:43339
I20260620 09:20:30.948215 14393 heartbeater.cc:464] Registering TS with master...
I20260620 09:20:30.949018 14393 heartbeater.cc:511] Master 127.9.154.254:43339 requested a full tablet report, sending...
I20260620 09:20:30.950840 14043 ts_manager.cc:194] Registered new tserver with Master: e211023b756747b8a759d831fe62121b (127.9.154.196:37411)
I20260620 09:20:30.951593  9835 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017367205s
I20260620 09:20:30.952600 14043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60186
I20260620 09:20:30.973968  9835 test_util.cc:268] Using random seed: -340398084
I20260620 09:20:31.003077 14043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60206:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260620 09:20:31.073400 14210 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff808579604e9fb6b4014e87a9a575 (DEFAULT_TABLE table=test-workload [id=b1ec56e8896b4f0b9c0cb10f1ce4ad9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:31.074720 14210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff808579604e9fb6b4014e87a9a575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:31.077070 14135 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff808579604e9fb6b4014e87a9a575 (DEFAULT_TABLE table=test-workload [id=b1ec56e8896b4f0b9c0cb10f1ce4ad9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:31.078039 14135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff808579604e9fb6b4014e87a9a575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:31.081272 14358 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff808579604e9fb6b4014e87a9a575 (DEFAULT_TABLE table=test-workload [id=b1ec56e8896b4f0b9c0cb10f1ce4ad9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 09:20:31.082612 14358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff808579604e9fb6b4014e87a9a575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:31.090327 14416 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Bootstrap starting.
I20260620 09:20:31.094074 14417 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: Bootstrap starting.
I20260620 09:20:31.097911 14416 tablet_bootstrap.cc:654] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:31.099306 14418 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: Bootstrap starting.
I20260620 09:20:31.100209 14417 tablet_bootstrap.cc:654] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:31.104351 14416 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: No bootstrap required, opened a new log
I20260620 09:20:31.104794 14416 ts_tablet_manager.cc:1397] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Time spent bootstrapping tablet: real 0.015s	user 0.000s	sys 0.010s
I20260620 09:20:31.105443 14417 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: No bootstrap required, opened a new log
I20260620 09:20:31.105474 14418 tablet_bootstrap.cc:654] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: Neither blocks nor log segments found. Creating new log.
I20260620 09:20:31.106103 14417 ts_tablet_manager.cc:1397] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260620 09:20:31.108505 14416 raft_consensus.cc:348] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.108695 14417 raft_consensus.cc:348] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.109342 14416 raft_consensus.cc:374] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:31.109431 14417 raft_consensus.cc:374] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:31.109728 14416 raft_consensus.cc:729] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8847a2f61c4db68bd72fe139fdecb8, State: Initialized, Role: FOLLOWER
I20260620 09:20:31.109797 14417 raft_consensus.cc:729] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9155372c4394cee81370c63c8920f9a, State: Initialized, Role: FOLLOWER
I20260620 09:20:31.110998 14418 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: No bootstrap required, opened a new log
I20260620 09:20:31.110630 14417 consensus_queue.cc:260] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.110566 14416 consensus_queue.cc:260] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.111492 14418 ts_tablet_manager.cc:1397] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260620 09:20:31.113289 14245 heartbeater.cc:503] Master 127.9.154.254:43339 was elected leader, sending a full tablet report...
I20260620 09:20:31.113919 14417 ts_tablet_manager.cc:1428] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 09:20:31.114558 14416 ts_tablet_manager.cc:1428] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260620 09:20:31.115029 14170 heartbeater.cc:503] Master 127.9.154.254:43339 was elected leader, sending a full tablet report...
I20260620 09:20:31.116194 14418 raft_consensus.cc:348] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.116851 14418 raft_consensus.cc:374] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 09:20:31.117045 14418 raft_consensus.cc:729] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e211023b756747b8a759d831fe62121b, State: Initialized, Role: FOLLOWER
I20260620 09:20:31.117638 14418 consensus_queue.cc:260] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.121930 14393 heartbeater.cc:503] Master 127.9.154.254:43339 was elected leader, sending a full tablet report...
I20260620 09:20:31.122416 14418 ts_tablet_manager.cc:1428] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260620 09:20:31.250665 14422 raft_consensus.cc:482] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:31.251243 14422 raft_consensus.cc:504] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.253539 14422 leader_election.cc:288] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e211023b756747b8a759d831fe62121b (127.9.154.196:37411), 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401)
I20260620 09:20:31.257478 14424 raft_consensus.cc:482] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 09:20:31.258031 14424 raft_consensus.cc:504] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.261979 14424 leader_election.cc:288] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343), 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401)
I20260620 09:20:31.279368 14145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "d9155372c4394cee81370c63c8920f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" is_pre_election: true
I20260620 09:20:31.280458 14145 raft_consensus.cc:2454] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9155372c4394cee81370c63c8920f9a in term 0.
I20260620 09:20:31.281028 14368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "d9155372c4394cee81370c63c8920f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e211023b756747b8a759d831fe62121b" is_pre_election: true
I20260620 09:20:31.281760 14184 leader_election.cc:302] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f8847a2f61c4db68bd72fe139fdecb8, d9155372c4394cee81370c63c8920f9a; no voters: 
I20260620 09:20:31.281883 14368 raft_consensus.cc:2454] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9155372c4394cee81370c63c8920f9a in term 0.
I20260620 09:20:31.282651 14422 raft_consensus.cc:2781] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 09:20:31.283041 14422 raft_consensus.cc:482] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 09:20:31.283398 14422 raft_consensus.cc:3037] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:31.288710 14220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "e211023b756747b8a759d831fe62121b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9155372c4394cee81370c63c8920f9a" is_pre_election: true
I20260620 09:20:31.289588 14422 raft_consensus.cc:504] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.290958 14220 raft_consensus.cc:2379] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e211023b756747b8a759d831fe62121b in current term 1: Already voted for candidate d9155372c4394cee81370c63c8920f9a in this term.
I20260620 09:20:31.291802 14422 leader_election.cc:288] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [CANDIDATE]: Term 1 election: Requested vote from peers e211023b756747b8a759d831fe62121b (127.9.154.196:37411), 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401)
I20260620 09:20:31.293642 14368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "d9155372c4394cee81370c63c8920f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e211023b756747b8a759d831fe62121b"
I20260620 09:20:31.293642 14145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "d9155372c4394cee81370c63c8920f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8847a2f61c4db68bd72fe139fdecb8"
I20260620 09:20:31.295396 14368 raft_consensus.cc:3037] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:31.295431 14145 raft_consensus.cc:3037] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 09:20:31.295539 14144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff808579604e9fb6b4014e87a9a575" candidate_uuid: "e211023b756747b8a759d831fe62121b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" is_pre_election: true
I20260620 09:20:31.297430 14332 leader_election.cc:302] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e211023b756747b8a759d831fe62121b; no voters: 7f8847a2f61c4db68bd72fe139fdecb8, d9155372c4394cee81370c63c8920f9a
I20260620 09:20:31.303179 14368 raft_consensus.cc:2454] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9155372c4394cee81370c63c8920f9a in term 1.
I20260620 09:20:31.303709 14424 raft_consensus.cc:2726] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 09:20:31.304122 14145 raft_consensus.cc:2454] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9155372c4394cee81370c63c8920f9a in term 1.
I20260620 09:20:31.305299 14184 leader_election.cc:302] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f8847a2f61c4db68bd72fe139fdecb8, d9155372c4394cee81370c63c8920f9a; no voters: 
I20260620 09:20:31.306309 14422 raft_consensus.cc:2781] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 09:20:31.307649 14422 raft_consensus.cc:686] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 LEADER]: Becoming Leader. State: Replica: d9155372c4394cee81370c63c8920f9a, State: Running, Role: LEADER
I20260620 09:20:31.308348 14422 consensus_queue.cc:237] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } }
I20260620 09:20:31.316174 14041 catalog_manager.cc:5495] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a reported cstate change: term changed from 0 to 1, leader changed from <none> to d9155372c4394cee81370c63c8920f9a (127.9.154.194). New cstate: current_term: 1 leader_uuid: "d9155372c4394cee81370c63c8920f9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 } health_report { overall_health: UNKNOWN } } }
I20260620 09:20:31.604157 14135 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:31.624673 14210 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:31.631443 14284 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:31.631573 14358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:31.740904 14422 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f8847a2f61c4db68bd72fe139fdecb8" member_type: VOTER last_known_addr { host: "127.9.154.193" port: 34401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 09:20:31.804261 14422 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 09:20:31.866782 14319 heartbeater.cc:503] Master 127.9.154.254:43339 was elected leader, sending a full tablet report...
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 a0550acbba7a405db79c3174d35c4cf8 | 127.9.154.254:43339 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | HEALTHY | <none>   |       0        |       0
 bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | HEALTHY | <none>   |       0        |       0
 d9155372c4394cee81370c63c8920f9a | 127.9.154.194:38343 | HEALTHY | <none>   |       1        |       0
 e211023b756747b8a759d831fe62121b | 127.9.154.196:37411 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 40ff808579604e9fb6b4014e87a9a575 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  e211023b756747b8a759d831fe62121b (127.9.154.196:37411): RUNNING
  d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343): RUNNING [LEADER]
  7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401): RUNNING
All reported replicas are:
  A = e211023b756747b8a759d831fe62121b
  B = d9155372c4394cee81370c63c8920f9a
  C = 7f8847a2f61c4db68bd72fe139fdecb8
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B*  C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |        Host         | Replica Count
-------+----------------------------------+---------------------+---------------
 Small | bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:31.934823  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:32.317180 14135 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:32.331750 14358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:32.331780 14210 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:32.341451 14284 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 a0550acbba7a405db79c3174d35c4cf8 | 127.9.154.254:43339 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | HEALTHY | <none>   |       0        |       0
 bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | HEALTHY | <none>   |       0        |       0
 d9155372c4394cee81370c63c8920f9a | 127.9.154.194:38343 | HEALTHY | <none>   |       1        |       0
 e211023b756747b8a759d831fe62121b | 127.9.154.196:37411 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |        Host         | Replica Count
-------+----------------------------------+---------------------+---------------
 Small | bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260620 09:20:32.561407  9835 log_verifier.cc:126] Checking tablet 40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:32.618101  9835 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:32.618588  9835 tablet_replica.cc:330] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: stopping tablet replica
I20260620 09:20:32.619076  9835 raft_consensus.cc:2229] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:32.619448  9835 raft_consensus.cc:2258] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:32.771142 14184 consensus_queue.cc:579] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: The tablet replica hosted on peer 7f8847a2f61c4db68bd72fe139fdecb8 has failed
W20260620 09:20:32.771651 14184 consensus_peers.cc:487] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a -> Peer 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401): Couldn't send request to peer 7f8847a2f61c4db68bd72fe139fdecb8. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:32.780193 14220 consensus_queue.cc:237] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } }
I20260620 09:20:32.784888 14368 raft_consensus.cc:1261] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Refusing update from remote peer d9155372c4394cee81370c63c8920f9a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 09:20:32.786167 14485 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 09:20:32.792852 14513 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } }
I20260620 09:20:32.794445 14368 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } }
I20260620 09:20:32.801626 14030 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 40ff808579604e9fb6b4014e87a9a575 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 09:20:32.805160 14041 catalog_manager.cc:5495] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a reported cstate change: config changed from index -1 to 2, VOTER 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193) evicted. New cstate: current_term: 1 leader_uuid: "d9155372c4394cee81370c63c8920f9a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } health_report { overall_health: HEALTHY } } }
I20260620 09:20:32.818032 14135 tablet_service.cc:1514] Processing DeleteTablet for tablet 40ff808579604e9fb6b4014e87a9a575 with delete_type TABLET_DATA_TOMBSTONED (TS 7f8847a2f61c4db68bd72fe139fdecb8 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:55208
I20260620 09:20:32.820210 14520 ts_tablet_manager.cc:1905] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 09:20:32.822548 14220 consensus_queue.cc:237] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } }
I20260620 09:20:32.837463 14368 raft_consensus.cc:1261] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Refusing update from remote peer d9155372c4394cee81370c63c8920f9a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 09:20:32.839529 14513 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 09:20:32.848424 14485 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } } }
I20260620 09:20:32.857347 14367 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } } }
I20260620 09:20:32.866750 14030 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 40ff808579604e9fb6b4014e87a9a575 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260620 09:20:32.870633 14041 catalog_manager.cc:5495] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a reported cstate change: config changed from index 2 to 3, NON_VOTER bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) added. New cstate: current_term: 1 leader_uuid: "d9155372c4394cee81370c63c8920f9a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 09:20:32.870456 14520 ts_tablet_manager.cc:1918] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260620 09:20:32.880927 14520 log.cc:1196] T 40ff808579604e9fb6b4014e87a9a575 P 7f8847a2f61c4db68bd72fe139fdecb8: Deleting WAL directory at /tmp/dist-test-taskChi5qk/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1781947168426282-9835-0/minicluster-data/ts-0-root/wals/40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:32.886058 14028 catalog_manager.cc:4841] TS 7f8847a2f61c4db68bd72fe139fdecb8 (127.9.154.193:34401): tablet 40ff808579604e9fb6b4014e87a9a575 (table test-workload [id=b1ec56e8896b4f0b9c0cb10f1ce4ad9f]) successfully deleted
I20260620 09:20:32.889662 14135 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260620 09:20:32.893154 14186 consensus_peers.cc:487] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a -> Peer bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195:41007): Couldn't send request to peer bad97c22888a4f0abb9b4cbedb064154. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40ff808579604e9fb6b4014e87a9a575. This is attempt 1: this message will repeat every 5th retry.
I20260620 09:20:32.916499 14358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:32.921897 14284 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:32.923048 14210 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 a0550acbba7a405db79c3174d35c4cf8 | 127.9.154.254:43339 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | HEALTHY | <none>   |       0        |       0
 bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | HEALTHY | <none>   |       0        |       0
 d9155372c4394cee81370c63c8920f9a | 127.9.154.194:38343 | HEALTHY | <none>   |       1        |       0
 e211023b756747b8a759d831fe62121b | 127.9.154.196:37411 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 40ff808579604e9fb6b4014e87a9a575 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  e211023b756747b8a759d831fe62121b (127.9.154.196:37411): RUNNING
  d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343): RUNNING [LEADER]
All reported replicas are:
  A = e211023b756747b8a759d831fe62121b
  B = d9155372c4394cee81370c63c8920f9a
  C = bad97c22888a4f0abb9b4cbedb064154
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*       |              |              | Yes
 A             | A   B*  C~   | 1            | 3            | Yes
 B             | A   B*  C~   | 1            | 3            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 0
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 2

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:33.123670  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:33.310783 14539 ts_tablet_manager.cc:927] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Initiating tablet copy from peer d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343)
I20260620 09:20:33.312485 14539 tablet_copy_client.cc:316] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: tablet copy: Beginning tablet copy session from remote peer at address 127.9.154.194:38343
I20260620 09:20:33.325251 14230 tablet_copy_service.cc:140] P d9155372c4394cee81370c63c8920f9a: Received BeginTabletCopySession request for tablet 40ff808579604e9fb6b4014e87a9a575 from peer bad97c22888a4f0abb9b4cbedb064154 ({username='slave'} at 127.0.0.1:40288)
I20260620 09:20:33.325753 14230 tablet_copy_service.cc:161] P d9155372c4394cee81370c63c8920f9a: Beginning new tablet copy session on tablet 40ff808579604e9fb6b4014e87a9a575 from peer bad97c22888a4f0abb9b4cbedb064154 at {username='slave'} at 127.0.0.1:40288: session id = bad97c22888a4f0abb9b4cbedb064154-40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:33.330914 14230 tablet_copy_source_session.cc:205] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 09:20:33.333314 14539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff808579604e9fb6b4014e87a9a575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 09:20:33.344316 14539 tablet_copy_client.cc:791] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: tablet copy: Starting download of 0 data blocks...
I20260620 09:20:33.344834 14539 tablet_copy_client.cc:655] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: tablet copy: Starting download of 1 WAL segments...
I20260620 09:20:33.348296 14539 tablet_copy_client.cc:531] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 09:20:33.356841 14539 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Bootstrap starting.
I20260620 09:20:33.373831 14539 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 09:20:33.374845 14539 tablet_bootstrap.cc:492] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Bootstrap complete.
I20260620 09:20:33.375499 14539 ts_tablet_manager.cc:1397] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260620 09:20:33.377641 14539 raft_consensus.cc:348] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } }
I20260620 09:20:33.378257 14539 raft_consensus.cc:729] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bad97c22888a4f0abb9b4cbedb064154, State: Initialized, Role: LEARNER
I20260620 09:20:33.378777 14539 consensus_queue.cc:260] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: NON_VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: true } }
I20260620 09:20:33.381314 14539 ts_tablet_manager.cc:1428] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260620 09:20:33.383167 14230 tablet_copy_service.cc:342] P d9155372c4394cee81370c63c8920f9a: Request end of tablet copy session bad97c22888a4f0abb9b4cbedb064154-40ff808579604e9fb6b4014e87a9a575 received from {username='slave'} at 127.0.0.1:40288
I20260620 09:20:33.383637 14230 tablet_copy_service.cc:433] P d9155372c4394cee81370c63c8920f9a: ending tablet copy session bad97c22888a4f0abb9b4cbedb064154-40ff808579604e9fb6b4014e87a9a575 on tablet 40ff808579604e9fb6b4014e87a9a575 with peer bad97c22888a4f0abb9b4cbedb064154
I20260620 09:20:33.516220 14135 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:33.524551 14358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:33.526950 14210 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260620 09:20:33.531126 14284 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 a0550acbba7a405db79c3174d35c4cf8 | 127.9.154.254:43339 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | HEALTHY | <none>   |       0        |       0
 bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | HEALTHY | <none>   |       0        |       0
 d9155372c4394cee81370c63c8920f9a | 127.9.154.194:38343 | HEALTHY | <none>   |       1        |       0
 e211023b756747b8a759d831fe62121b | 127.9.154.196:37411 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 40ff808579604e9fb6b4014e87a9a575 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  e211023b756747b8a759d831fe62121b (127.9.154.196:37411): RUNNING
  d9155372c4394cee81370c63c8920f9a (127.9.154.194:38343): RUNNING [LEADER]
  bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195:41007): RUNNING [NONVOTER]
All reported replicas are:
  A = e211023b756747b8a759d831fe62121b
  B = d9155372c4394cee81370c63c8920f9a
  C = bad97c22888a4f0abb9b4cbedb064154
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C~   |              |              | Yes
 A             | A   B*  C~   | 1            | 3            | Yes
 B             | A   B*  C~   | 1            | 3            | Yes
 C             | A   B   C~   | 1            | 3            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |        Host         | Replica Count
-------+----------------------------------+---------------------+---------------
 Small | 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260620 09:20:33.745817  9835 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260620 09:20:33.866716 14294 raft_consensus.cc:1203] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3]   Dedup: 1.3->[]
I20260620 09:20:34.218055 14135 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:34.221750 14284 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:34.225325 14358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260620 09:20:34.235379 14210 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 a0550acbba7a405db79c3174d35c4cf8 | 127.9.154.254:43339 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | HEALTHY | <none>   |       0        |       0
 bad97c22888a4f0abb9b4cbedb064154 | 127.9.154.195:41007 | HEALTHY | <none>   |       0        |       0
 d9155372c4394cee81370c63c8920f9a | 127.9.154.194:38343 | HEALTHY | <none>   |       1        |       0
 e211023b756747b8a759d831fe62121b | 127.9.154.196:37411 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.18.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |        Host         | Replica Count
-------+----------------------------------+---------------------+---------------
 Small | 7f8847a2f61c4db68bd72fe139fdecb8 | 127.9.154.193:34401 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260620 09:20:34.457830  9835 log_verifier.cc:126] Checking tablet 40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:34.477347 14567 raft_consensus.cc:1050] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: attempting to promote NON_VOTER bad97c22888a4f0abb9b4cbedb064154 to VOTER
I20260620 09:20:34.478950 14567 consensus_queue.cc:237] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false } }
I20260620 09:20:34.484800 14294 raft_consensus.cc:1261] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 LEARNER]: Refusing update from remote peer d9155372c4394cee81370c63c8920f9a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 09:20:34.484958 14367 raft_consensus.cc:1261] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Refusing update from remote peer d9155372c4394cee81370c63c8920f9a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 09:20:34.486780 14598 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 09:20:34.490445 14598 consensus_queue.cc:1035] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 09:20:34.502506 14567 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false } } }
I20260620 09:20:34.505317 14294 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false } } }
I20260620 09:20:34.505705 14367 raft_consensus.cc:2932] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false } } }
I20260620 09:20:34.520304 14043 catalog_manager.cc:5495] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a reported cstate change: config changed from index 3 to 4, bad97c22888a4f0abb9b4cbedb064154 (127.9.154.195) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d9155372c4394cee81370c63c8920f9a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e211023b756747b8a759d831fe62121b" member_type: VOTER last_known_addr { host: "127.9.154.196" port: 37411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9155372c4394cee81370c63c8920f9a" member_type: VOTER last_known_addr { host: "127.9.154.194" port: 38343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad97c22888a4f0abb9b4cbedb064154" member_type: VOTER last_known_addr { host: "127.9.154.195" port: 41007 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 09:20:34.554448  9835 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 40ff808579604e9fb6b4014e87a9a575
I20260620 09:20:34.557267  9835 tablet_server.cc:178] TabletServer@127.9.154.193:0 shutting down...
I20260620 09:20:34.579398  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:34.598409  9835 tablet_server.cc:194] TabletServer@127.9.154.193:0 shutdown complete.
I20260620 09:20:34.606932  9835 tablet_server.cc:178] TabletServer@127.9.154.194:0 shutting down...
I20260620 09:20:34.623682  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:34.624373  9835 tablet_replica.cc:330] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a: stopping tablet replica
I20260620 09:20:34.624908  9835 raft_consensus.cc:2229] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:34.625707  9835 raft_consensus.cc:2258] T 40ff808579604e9fb6b4014e87a9a575 P d9155372c4394cee81370c63c8920f9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:34.636731  9835 tablet_server.cc:194] TabletServer@127.9.154.194:0 shutdown complete.
I20260620 09:20:34.645716  9835 tablet_server.cc:178] TabletServer@127.9.154.195:0 shutting down...
I20260620 09:20:34.665541  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:34.666121  9835 tablet_replica.cc:330] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154: stopping tablet replica
I20260620 09:20:34.666674  9835 raft_consensus.cc:2229] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:34.667061  9835 raft_consensus.cc:2258] T 40ff808579604e9fb6b4014e87a9a575 P bad97c22888a4f0abb9b4cbedb064154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:34.687003  9835 tablet_server.cc:194] TabletServer@127.9.154.195:0 shutdown complete.
I20260620 09:20:34.695343  9835 tablet_server.cc:178] TabletServer@127.9.154.196:0 shutting down...
I20260620 09:20:34.716079  9835 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 09:20:34.716696  9835 tablet_replica.cc:330] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b: stopping tablet replica
I20260620 09:20:34.717231  9835 raft_consensus.cc:2229] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 09:20:34.717723  9835 raft_consensus.cc:2258] T 40ff808579604e9fb6b4014e87a9a575 P e211023b756747b8a759d831fe62121b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:34.739691  9835 tablet_server.cc:194] TabletServer@127.9.154.196:0 shutdown complete.
I20260620 09:20:34.748220  9835 master.cc:537] Master@127.9.154.254:43339 shutting down...
I20260620 09:20:34.766088  9835 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 1 LEADER]: Raft consensus shutting down.
I20260620 09:20:34.766734  9835 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 09:20:34.767067  9835 tablet_replica.cc:330] T 00000000000000000000000000000000 P a0550acbba7a405db79c3174d35c4cf8: stopping tablet replica
I20260620 09:20:34.786955  9835 master.cc:552] Master@127.9.154.254:43339 shutdown complete.
[       OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4482 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (9234 ms total)

[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (66224 ms total)
[  PASSED  ] 11 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[  FAILED  ] 1 test, listed below:
[  FAILED  ] TsTabletManagerITest.TestTableStats

 1 FAILED TEST
I20260620 09:20:34.822074  9835 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~10 seconds ago
I20260620 09:20:34.822450  9835 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~14 seconds ago
I20260620 09:20:34.822635  9835 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 113 messages since previous log ~57 seconds ago
I20260620 09:20:34.822963  9835 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 9 messages since previous log ~13 seconds ago