Diagnosed failure

TsTabletManagerITest.TestTableStats: /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:784: Failure
Expected equality of these values:
  live_row_count
    Which is: 67
  table_info->GetMetrics()->live_row_count->value()
    Which is: 134
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:768: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:786: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 784, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:896: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20261115 14:58:26.159400 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
W20261115 14:58:26.163785 13992 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20261115 14:58:26.168682 13992 consensus_peers.cc:597] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 -> Peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Couldn't send request to peer 25a1f4bd36e14df983b98a471f53f937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.202621 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
W20261115 14:58:26.202669 14070 consensus_peers.cc:597] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e -> Peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Couldn't send request to peer 25a1f4bd36e14df983b98a471f53f937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.203594 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.204422 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.205389 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.207859 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.208335 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.208705 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.210474 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.210831 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.211150 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.256417 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:26.279505 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
W20261115 14:58:26.316052 14067 consensus_peers.cc:597] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e -> Peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Couldn't send request to peer 4386ed1ad6b443ef9186a4c8218b2f44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.340801 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:26.341706 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.342487 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.343183 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.345147 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.345846 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.346791 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.348706 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.349311 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.349915 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.395421 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:26.405782 14624 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:26.406286 14624 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:26.416244 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
W20261115 14:58:26.416124 14070 leader_election.cc:336] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Network error: Client connection negotiation failed: client connection to 127.12.1.1:35611: connect: Connection refused (error 111)
I20261115 14:58:26.416728 14624 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
W20261115 14:58:26.420888 14067 leader_election.cc:336] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Network error: Client connection negotiation failed: client connection to 127.12.1.2:46463: connect: Connection refused (error 111)
I20261115 14:58:26.421439 14067 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:26.422215 14624 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261115 14:58:26.447101 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:26.447813 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.448415 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.448913 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.450817 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.451267 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.451967 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.453711 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.454138 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.454535 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.500468 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:58:26.512758 12292 master.cc:585] Master@127.12.1.62:35143 shutting down...
I20261115 14:58:26.539557 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.540208 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.540556 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: stopping tablet replica
I20261115 14:58:26.561339 12292 master.cc:607] Master@127.12.1.62:35143 shutdown complete.
I20261115 14:58:26.579084 12292 master.cc:585] Master@127.12.1.61:44723 shutting down...
I20261115 14:58:26.601188 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.601955 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.602432 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:26.643747 12292 master.cc:607] Master@127.12.1.61:44723 shutdown complete.
I20261115 14:58:26.659019 12292 master.cc:585] Master@127.12.1.60:43497 shutting down...
I20261115 14:58:26.678396 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.678906 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.679160 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:26.717007 12292 master.cc:607] Master@127.12.1.60:43497 shutdown complete.
I20261115 14:58:26.740732 12292 test_util.cc:182] -----------------------------------------------
I20261115 14:58:26.740954 12292 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0

Full log

[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN      ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20261115 14:57:37.923007 12292 thread.cc:642] rpc reactor (reactor) Time spent creating pthread: real 1.188s	user 0.487s	sys 0.698s
W20261115 14:57:37.923511 12292 thread.cc:609] rpc reactor (reactor) Time spent starting thread: real 1.189s	user 0.487s	sys 0.698s
I20261115 14:57:37.926143 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:41857
I20261115 14:57:37.927963 12292 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261115 14:57:37.929340 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:37.941653 12303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:37.943204 12304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:38.101799 12306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:38.101902 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:38.103642 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:38.103976 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:38.104256 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754658104226 us; error 0 us; skew 500 ppm
I20261115 14:57:38.105369 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:38.118847 12292 webserver.cc:577] Webserver started at http://127.12.1.62:38623/ using document root <none> and password file <none>
I20261115 14:57:38.119793 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:38.120074 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:38.120630 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:38.126325 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "8ce22574c2a34c999f721a05ecda893f"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.134485 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.008s
I20261115 14:57:38.139804 12311 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.141184 12292 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20261115 14:57:38.141561 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "8ce22574c2a34c999f721a05ecda893f"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.141929 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:38.163561 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:38.165190 12292 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261115 14:57:38.165663 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:38.238392 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:41857
I20261115 14:57:38.238467 12362 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:41857 every 8 connection(s)
I20261115 14:57:38.245158 12363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:38.266314 12363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: Bootstrap starting.
I20261115 14:57:38.272790 12363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:38.274693 12363 log.cc:826] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: Log is configured to *not* fsync() on all Append() calls
I20261115 14:57:38.279320 12363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: No bootstrap required, opened a new log
I20261115 14:57:38.300019 12363 raft_consensus.cc:360] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER }
I20261115 14:57:38.300695 12363 raft_consensus.cc:386] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:38.300966 12363 raft_consensus.cc:748] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ce22574c2a34c999f721a05ecda893f, State: Initialized, Role: FOLLOWER
I20261115 14:57:38.301894 12363 consensus_queue.cc:261] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER }
I20261115 14:57:38.302397 12363 raft_consensus.cc:400] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:57:38.302699 12363 raft_consensus.cc:499] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:57:38.303066 12363 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:38.307276 12363 raft_consensus.cc:521] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER }
I20261115 14:57:38.307986 12363 leader_election.cc:304] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ce22574c2a34c999f721a05ecda893f; no voters: 
I20261115 14:57:38.309790 12363 leader_election.cc:290] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:57:38.310209 12366 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:38.312883 12366 raft_consensus.cc:705] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 1 LEADER]: Becoming Leader. State: Replica: 8ce22574c2a34c999f721a05ecda893f, State: Running, Role: LEADER
I20261115 14:57:38.313771 12366 consensus_queue.cc:238] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER }
I20261115 14:57:38.314744 12363 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:38.322256 12368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ce22574c2a34c999f721a05ecda893f. Latest consensus state: current_term: 1 leader_uuid: "8ce22574c2a34c999f721a05ecda893f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER } }
I20261115 14:57:38.322646 12367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ce22574c2a34c999f721a05ecda893f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce22574c2a34c999f721a05ecda893f" member_type: VOTER } }
I20261115 14:57:38.323261 12368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:38.323398 12367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:38.327819 12375 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:38.338642 12375 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:38.341454 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:38.354822 12375 catalog_manager.cc:1398] Generated new cluster ID: 9445baf5d9e9495298b7366b53e1dedf
I20261115 14:57:38.355158 12375 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:38.370657 12375 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:38.372736 12375 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:38.388229 12375 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: Generated new TSK 0
I20261115 14:57:38.389245 12375 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:38.408432 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:38.417869 12385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:38.419374 12386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:38.424113 12388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:38.424328 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:38.425199 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:38.425424 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:38.425614 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754658425597 us; error 0 us; skew 500 ppm
I20261115 14:57:38.426209 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:38.430049 12292 webserver.cc:577] Webserver started at http://127.12.1.1:40365/ using document root <none> and password file <none>
I20261115 14:57:38.430603 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:38.430835 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:38.431131 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:38.432507 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "825acaa2e7314c78ad88eb4b46b82d3b"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.438434 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20261115 14:57:38.442924 12393 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.443902 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261115 14:57:38.444250 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "825acaa2e7314c78ad88eb4b46b82d3b"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.444571 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:38.463019 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:38.464425 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:38.466747 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:38.470847 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:38.471153 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.471432 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:38.471623 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.569065 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:39829
I20261115 14:57:38.569196 12455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:39829 every 8 connection(s)
I20261115 14:57:38.576315 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:38.586673 12460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:38.599195 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:38.600009 12461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:38.600965 12463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:38.601446 12456 heartbeater.cc:345] Connected to a master server at 127.12.1.62:41857
I20261115 14:57:38.601943 12456 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:38.601994 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:38.602294 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:38.602494 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754658602474 us; error 0 us; skew 500 ppm
I20261115 14:57:38.603241 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:38.603181 12456 heartbeater.cc:508] Master 127.12.1.62:41857 requested a full tablet report, sending...
I20261115 14:57:38.606745 12292 webserver.cc:577] Webserver started at http://127.12.1.2:38527/ using document root <none> and password file <none>
I20261115 14:57:38.607425 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:38.607506 12328 ts_manager.cc:210] Registered new tserver with Master: 825acaa2e7314c78ad88eb4b46b82d3b (127.12.1.1:39829)
I20261115 14:57:38.607692 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:38.608045 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:38.609674 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "6e42a4bfa1c9443f80341c92b0891f80"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.610669 12328 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55072
I20261115 14:57:38.616321 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.006s
I20261115 14:57:38.620775 12468 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.621646 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20261115 14:57:38.621932 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "6e42a4bfa1c9443f80341c92b0891f80"
format_stamp: "Formatted at 2026-11-15 14:57:38 on dist-test-slave-fhcn"
I20261115 14:57:38.622200 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:38.636222 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:38.637488 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:38.638998 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:38.641899 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:38.642079 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.642373 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:38.642513 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:38.714659 12456 heartbeater.cc:500] Master 127.12.1.62:41857 was elected leader, sending a full tablet report...
I20261115 14:57:38.739377 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:46319
I20261115 14:57:38.739560 12530 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:46319 every 8 connection(s)
I20261115 14:57:38.759346 12531 heartbeater.cc:345] Connected to a master server at 127.12.1.62:41857
I20261115 14:57:38.759805 12531 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:38.760679 12531 heartbeater.cc:508] Master 127.12.1.62:41857 requested a full tablet report, sending...
I20261115 14:57:38.762528 12328 ts_manager.cc:210] Registered new tserver with Master: 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2:46319)
I20261115 14:57:38.762970 12292 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.014312994s
I20261115 14:57:38.764215 12328 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55078
I20261115 14:57:38.794926 12328 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55094:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
  hash_schema {
    columns {
      name: "key"
    }
    num_buckets: 2
    seed: 0
  }
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20261115 14:57:38.813700 12328 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20261115 14:57:38.866863 12531 heartbeater.cc:500] Master 127.12.1.62:41857 was elected leader, sending a full tablet report...
I20261115 14:57:38.871515 12496 tablet_service.cc:1500] Processing CreateTablet for tablet 19448e1fb6434ccd9e9f605cba67d3f8 (DEFAULT_TABLE table=test-table [id=de9a14c4e514415baba4633cd94f6cf2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:38.873391 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19448e1fb6434ccd9e9f605cba67d3f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:38.875690 12421 tablet_service.cc:1500] Processing CreateTablet for tablet 19448e1fb6434ccd9e9f605cba67d3f8 (DEFAULT_TABLE table=test-table [id=de9a14c4e514415baba4633cd94f6cf2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:38.877080 12421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19448e1fb6434ccd9e9f605cba67d3f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:38.881516 12420 tablet_service.cc:1500] Processing CreateTablet for tablet 38851601b5a9421883f635ec6eef631f (DEFAULT_TABLE table=test-table [id=de9a14c4e514415baba4633cd94f6cf2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:38.882795 12420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38851601b5a9421883f635ec6eef631f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:38.885250 12495 tablet_service.cc:1500] Processing CreateTablet for tablet 38851601b5a9421883f635ec6eef631f (DEFAULT_TABLE table=test-table [id=de9a14c4e514415baba4633cd94f6cf2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:38.886512 12495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38851601b5a9421883f635ec6eef631f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:38.906438 12544 tablet_bootstrap.cc:492] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: Bootstrap starting.
I20261115 14:57:38.915473 12544 tablet_bootstrap.cc:654] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:38.915436 12545 tablet_bootstrap.cc:492] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: Bootstrap starting.
I20261115 14:57:38.921715 12545 tablet_bootstrap.cc:654] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:38.921947 12544 tablet_bootstrap.cc:492] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: No bootstrap required, opened a new log
I20261115 14:57:38.922397 12544 ts_tablet_manager.cc:1449] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20261115 14:57:38.926124 12544 raft_consensus.cc:360] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.926767 12544 raft_consensus.cc:748] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Initialized, Role: FOLLOWER
I20261115 14:57:38.927328 12544 consensus_queue.cc:261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.930900 12544 ts_tablet_manager.cc:1480] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20261115 14:57:38.931883 12544 tablet_bootstrap.cc:492] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: Bootstrap starting.
I20261115 14:57:38.934532 12545 tablet_bootstrap.cc:492] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: No bootstrap required, opened a new log
I20261115 14:57:38.934971 12545 ts_tablet_manager.cc:1449] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20261115 14:57:38.937767 12545 raft_consensus.cc:360] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.938342 12545 raft_consensus.cc:748] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825acaa2e7314c78ad88eb4b46b82d3b, State: Initialized, Role: FOLLOWER
I20261115 14:57:38.938462 12544 tablet_bootstrap.cc:654] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:38.938899 12545 consensus_queue.cc:261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.942843 12545 ts_tablet_manager.cc:1480] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20261115 14:57:38.947081 12545 tablet_bootstrap.cc:492] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: Bootstrap starting.
I20261115 14:57:38.961709 12545 tablet_bootstrap.cc:654] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:38.962884 12544 tablet_bootstrap.cc:492] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: No bootstrap required, opened a new log
I20261115 14:57:38.963361 12544 ts_tablet_manager.cc:1449] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.020s
I20261115 14:57:38.966290 12545 tablet_bootstrap.cc:492] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: No bootstrap required, opened a new log
I20261115 14:57:38.966161 12544 raft_consensus.cc:360] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.966746 12545 ts_tablet_manager.cc:1449] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.006s
I20261115 14:57:38.966800 12544 raft_consensus.cc:748] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Initialized, Role: FOLLOWER
I20261115 14:57:38.967446 12544 consensus_queue.cc:261] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.969470 12545 raft_consensus.cc:360] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.969966 12544 ts_tablet_manager.cc:1480] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20261115 14:57:38.970075 12545 raft_consensus.cc:748] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825acaa2e7314c78ad88eb4b46b82d3b, State: Initialized, Role: FOLLOWER
I20261115 14:57:38.970693 12545 consensus_queue.cc:261] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:38.974646 12545 ts_tablet_manager.cc:1480] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
W20261115 14:57:38.999475 12532 tablet.cc:2441] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261115 14:57:39.014354 12292 ts_tablet_manager-itest.cc:368] Electing peer 2...
I20261115 14:57:39.014686 12292 raft_consensus.cc:425] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Emulating election...
I20261115 14:57:39.014933 12292 raft_consensus.cc:3096] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:39.018787 12292 raft_consensus.cc:705] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Becoming Leader. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.019395 12292 consensus_queue.cc:238] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.023074 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:39.030965 12327 catalog_manager.cc:5840] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2). New cstate: current_term: 1 leader_uuid: "6e42a4bfa1c9443f80341c92b0891f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:39.047978 12431 raft_consensus.cc:3096] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:39.056707 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20261115 14:57:39.056860 12548 consensus_queue.cc:1049] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:57:39.161156 12292 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20261115 14:57:39.161468 12292 raft_consensus.cc:425] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Emulating election...
I20261115 14:57:39.161752 12292 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:39.167594 12292 raft_consensus.cc:705] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Becoming Leader. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.168349 12292 consensus_queue.cc:238] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.173045 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:39.173004 12431 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:39.175824 12327 catalog_manager.cc:5840] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2). New cstate: current_term: 1 leader_uuid: "6e42a4bfa1c9443f80341c92b0891f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:39.183776 12548 consensus_queue.cc:1049] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:39.186825 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20261115 14:57:39.491480 12292 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20261115 14:57:39.491796 12292 raft_consensus.cc:425] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Emulating election...
I20261115 14:57:39.492115 12292 raft_consensus.cc:3091] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:39.492376 12292 raft_consensus.cc:748] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.492959 12292 consensus_queue.cc:261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.493958 12292 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:39.500105 12292 raft_consensus.cc:705] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 LEADER]: Becoming Leader. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.500809 12292 consensus_queue.cc:238] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.504554 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:39.505345 12430 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:39.507841 12327 catalog_manager.cc:5840] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "6e42a4bfa1c9443f80341c92b0891f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:39.513217 12430 raft_consensus.cc:1285] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 FOLLOWER]: Refusing update from remote peer 6e42a4bfa1c9443f80341c92b0891f80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20261115 14:57:39.515950 12548 consensus_queue.cc:1049] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261115 14:57:39.518540 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20261115 14:57:39.622982 12292 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20261115 14:57:39.623281 12292 raft_consensus.cc:425] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 1 FOLLOWER]: Emulating election...
I20261115 14:57:39.623560 12292 raft_consensus.cc:3096] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:39.630915 12292 raft_consensus.cc:705] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 LEADER]: Becoming Leader. State: Replica: 825acaa2e7314c78ad88eb4b46b82d3b, State: Running, Role: LEADER
I20261115 14:57:39.631645 12292 consensus_queue.cc:238] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.638788 12328 catalog_manager.cc:5840] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b reported cstate change: term changed from 1 to 2, leader changed from 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2) to 825acaa2e7314c78ad88eb4b46b82d3b (127.12.1.1). New cstate: current_term: 2 leader_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:39.640640 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:39.651261 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20261115 14:57:39.662415 12506 raft_consensus.cc:3091] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:39.662935 12506 raft_consensus.cc:748] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.663652 12506 consensus_queue.cc:261] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.664683 12506 raft_consensus.cc:3096] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:39.670450 12506 raft_consensus.cc:1285] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 FOLLOWER]: Refusing update from remote peer 825acaa2e7314c78ad88eb4b46b82d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20261115 14:57:39.672447 12549 consensus_queue.cc:1049] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20261115 14:57:39.957147 12292 ts_tablet_manager-itest.cc:368] Electing peer 1...
I20261115 14:57:39.957432 12292 raft_consensus.cc:425] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 FOLLOWER]: Emulating election...
I20261115 14:57:39.957703 12292 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:39.962800 12292 raft_consensus.cc:705] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 3 LEADER]: Becoming Leader. State: Replica: 825acaa2e7314c78ad88eb4b46b82d3b, State: Running, Role: LEADER
I20261115 14:57:39.963429 12292 consensus_queue.cc:238] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.965600 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:39.966966 12506 raft_consensus.cc:3091] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 LEADER]: Stepping down as leader of term 2
I20261115 14:57:39.967308 12506 raft_consensus.cc:748] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:39.967933 12506 consensus_queue.cc:261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:39.969010 12506 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:39.968781 12327 catalog_manager.cc:5840] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b reported cstate change: term changed from 2 to 3, leader changed from 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2) to 825acaa2e7314c78ad88eb4b46b82d3b (127.12.1.1). New cstate: current_term: 3 leader_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:39.975761 12506 raft_consensus.cc:1285] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 3 FOLLOWER]: Refusing update from remote peer 825acaa2e7314c78ad88eb4b46b82d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20261115 14:57:39.977981 12566 consensus_queue.cc:1049] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20261115 14:57:39.978330 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20261115 14:57:40.083254 12292 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20261115 14:57:40.083475 12292 raft_consensus.cc:425] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 3 FOLLOWER]: Emulating election...
I20261115 14:57:40.083726 12292 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:40.087460 12292 raft_consensus.cc:705] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 4 LEADER]: Becoming Leader. State: Replica: 6e42a4bfa1c9443f80341c92b0891f80, State: Running, Role: LEADER
I20261115 14:57:40.088060 12292 consensus_queue.cc:238] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:40.089553 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:40.092059 12430 raft_consensus.cc:3091] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 3 LEADER]: Stepping down as leader of term 3
I20261115 14:57:40.092413 12430 raft_consensus.cc:748] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 825acaa2e7314c78ad88eb4b46b82d3b, State: Running, Role: LEADER
I20261115 14:57:40.093016 12430 consensus_queue.cc:261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } }
I20261115 14:57:40.093919 12430 raft_consensus.cc:3096] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:40.094220 12328 catalog_manager.cc:5840] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 reported cstate change: term changed from 3 to 4, leader changed from 825acaa2e7314c78ad88eb4b46b82d3b (127.12.1.1) to 6e42a4bfa1c9443f80341c92b0891f80 (127.12.1.2). New cstate: current_term: 4 leader_uuid: "6e42a4bfa1c9443f80341c92b0891f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e42a4bfa1c9443f80341c92b0891f80" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46319 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:40.099886 12292 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20261115 14:57:40.102543 12430 raft_consensus.cc:1285] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 4 FOLLOWER]: Refusing update from remote peer 6e42a4bfa1c9443f80341c92b0891f80: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20261115 14:57:40.104159 12557 consensus_queue.cc:1049] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "825acaa2e7314c78ad88eb4b46b82d3b" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:57:40.406858 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:57:40.427413 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:40.428242 12292 tablet_replica.cc:333] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b: stopping tablet replica
I20261115 14:57:40.428958 12292 raft_consensus.cc:2261] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 LEADER]: Raft consensus shutting down.
I20261115 14:57:40.429754 12292 raft_consensus.cc:2290] T 38851601b5a9421883f635ec6eef631f P 825acaa2e7314c78ad88eb4b46b82d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:40.432385 12292 tablet_replica.cc:333] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b: stopping tablet replica
I20261115 14:57:40.432832 12292 raft_consensus.cc:2261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20261115 14:57:40.433223 12292 raft_consensus.cc:2290] T 19448e1fb6434ccd9e9f605cba67d3f8 P 825acaa2e7314c78ad88eb4b46b82d3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:40.515856 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
W20261115 14:57:40.521544 12472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.1.1:39829: connect: Connection refused (error 111)
W20261115 14:57:40.525133 12472 consensus_peers.cc:597] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 -> Peer 825acaa2e7314c78ad88eb4b46b82d3b (127.12.1.1:39829): Couldn't send request to peer 825acaa2e7314c78ad88eb4b46b82d3b. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.1:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261115 14:57:40.525732 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:57:40.542301 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:40.542824 12292 tablet_replica.cc:333] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80: stopping tablet replica
I20261115 14:57:40.543260 12292 raft_consensus.cc:2261] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20261115 14:57:40.543630 12292 raft_consensus.cc:2290] T 38851601b5a9421883f635ec6eef631f P 6e42a4bfa1c9443f80341c92b0891f80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:40.545476 12292 tablet_replica.cc:333] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80: stopping tablet replica
I20261115 14:57:40.545863 12292 raft_consensus.cc:2261] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 4 LEADER]: Raft consensus shutting down.
I20261115 14:57:40.546321 12292 raft_consensus.cc:2290] T 19448e1fb6434ccd9e9f605cba67d3f8 P 6e42a4bfa1c9443f80341c92b0891f80 [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:40.565706 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:57:40.573383 12292 master.cc:585] Master@127.12.1.62:41857 shutting down...
I20261115 14:57:40.652697 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:40.653164 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:40.653414 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8ce22574c2a34c999f721a05ecda893f: stopping tablet replica
I20261115 14:57:40.670658 12292 master.cc:607] Master@127.12.1.62:41857 shutdown complete.
[       OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (4005 ms)
[ RUN      ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20261115 14:57:40.696412 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:37561
I20261115 14:57:40.697405 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:40.702317 12575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:40.703275 12576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:40.704521 12578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:40.705078 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:40.706142 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:40.706313 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:40.706516 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754660706483 us; error 0 us; skew 500 ppm
I20261115 14:57:40.707074 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:40.709404 12292 webserver.cc:577] Webserver started at http://127.12.1.62:37735/ using document root <none> and password file <none>
I20261115 14:57:40.709877 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:40.710059 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:40.710342 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:40.711376 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "23b06b50a6f944dbac496ca4230e06d1"
format_stamp: "Formatted at 2026-11-15 14:57:40 on dist-test-slave-fhcn"
I20261115 14:57:40.715886 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:40.719273 12583 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:40.720217 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:40.720464 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "23b06b50a6f944dbac496ca4230e06d1"
format_stamp: "Formatted at 2026-11-15 14:57:40 on dist-test-slave-fhcn"
I20261115 14:57:40.720717 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:40.740619 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:40.741550 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:40.774820 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:37561
I20261115 14:57:40.774909 12634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:37561 every 8 connection(s)
I20261115 14:57:40.778647 12635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:40.787545 12635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1: Bootstrap starting.
I20261115 14:57:40.791551 12635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:40.795565 12635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1: No bootstrap required, opened a new log
I20261115 14:57:40.797566 12635 raft_consensus.cc:360] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER }
I20261115 14:57:40.797986 12635 raft_consensus.cc:386] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:40.798245 12635 raft_consensus.cc:748] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23b06b50a6f944dbac496ca4230e06d1, State: Initialized, Role: FOLLOWER
I20261115 14:57:40.798874 12635 consensus_queue.cc:261] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER }
I20261115 14:57:40.799326 12635 raft_consensus.cc:400] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:57:40.799566 12635 raft_consensus.cc:499] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:57:40.799844 12635 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:40.803929 12635 raft_consensus.cc:521] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER }
I20261115 14:57:40.804442 12635 leader_election.cc:304] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23b06b50a6f944dbac496ca4230e06d1; no voters: 
I20261115 14:57:40.805485 12635 leader_election.cc:290] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:57:40.805774 12638 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:40.807053 12638 raft_consensus.cc:705] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 1 LEADER]: Becoming Leader. State: Replica: 23b06b50a6f944dbac496ca4230e06d1, State: Running, Role: LEADER
I20261115 14:57:40.807653 12638 consensus_queue.cc:238] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER }
I20261115 14:57:40.808316 12635 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:40.810214 12639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23b06b50a6f944dbac496ca4230e06d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER } }
I20261115 14:57:40.810297 12640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23b06b50a6f944dbac496ca4230e06d1. Latest consensus state: current_term: 1 leader_uuid: "23b06b50a6f944dbac496ca4230e06d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b06b50a6f944dbac496ca4230e06d1" member_type: VOTER } }
I20261115 14:57:40.810835 12639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:40.810925 12640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:40.815449 12643 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:40.821280 12643 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:40.822443 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:40.829352 12643 catalog_manager.cc:1398] Generated new cluster ID: 341698419068471c87576a7819ce4d31
I20261115 14:57:40.829578 12643 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:40.845091 12643 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:40.846299 12643 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:40.859263 12643 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1: Generated new TSK 0
I20261115 14:57:40.859833 12643 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:40.888864 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:40.894369 12656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:40.895711 12657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:40.897198 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:40.897678 12659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:40.898466 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:40.898707 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:40.898883 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754660898867 us; error 0 us; skew 500 ppm
I20261115 14:57:40.899394 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:40.901726 12292 webserver.cc:577] Webserver started at http://127.12.1.1:45477/ using document root <none> and password file <none>
I20261115 14:57:40.902194 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:40.902398 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:40.902666 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:40.903697 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "10f177ae21e041bd92035c3397fa783d"
format_stamp: "Formatted at 2026-11-15 14:57:40 on dist-test-slave-fhcn"
I20261115 14:57:40.907908 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20261115 14:57:40.912160 12664 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:40.913049 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261115 14:57:40.913341 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "10f177ae21e041bd92035c3397fa783d"
format_stamp: "Formatted at 2026-11-15 14:57:40 on dist-test-slave-fhcn"
I20261115 14:57:40.913586 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:40.964993 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:40.966035 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:40.967420 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:40.969622 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:40.969854 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:40.970105 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:40.970273 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.007253 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:38355
I20261115 14:57:41.007376 12726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:38355 every 8 connection(s)
I20261115 14:57:41.012243 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:41.018520 12731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:41.020107 12732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.022523 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:41.022495 12734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.023483 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:41.023670 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:41.023793 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754661023782 us; error 0 us; skew 500 ppm
I20261115 14:57:41.024317 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:41.026902 12292 webserver.cc:577] Webserver started at http://127.12.1.2:39117/ using document root <none> and password file <none>
I20261115 14:57:41.027454 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:41.027680 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:41.027945 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:41.028327 12727 heartbeater.cc:345] Connected to a master server at 127.12.1.62:37561
I20261115 14:57:41.028666 12727 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:41.029170 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "681f421042154252b6fba2db54906c29"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.029337 12727 heartbeater.cc:508] Master 127.12.1.62:37561 requested a full tablet report, sending...
I20261115 14:57:41.031391 12600 ts_manager.cc:210] Registered new tserver with Master: 10f177ae21e041bd92035c3397fa783d (127.12.1.1:38355)
I20261115 14:57:41.033108 12600 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39572
I20261115 14:57:41.034041 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20261115 14:57:41.037401 12739 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.038147 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:41.038439 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "681f421042154252b6fba2db54906c29"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.038746 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:41.059290 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:41.060446 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:41.061841 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:41.063961 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:41.064257 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.064507 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:41.064700 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.100956 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:34923
I20261115 14:57:41.101030 12801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:34923 every 8 connection(s)
I20261115 14:57:41.113698 12802 heartbeater.cc:345] Connected to a master server at 127.12.1.62:37561
I20261115 14:57:41.114073 12802 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:41.114779 12802 heartbeater.cc:508] Master 127.12.1.62:37561 requested a full tablet report, sending...
I20261115 14:57:41.116858 12600 ts_manager.cc:210] Registered new tserver with Master: 681f421042154252b6fba2db54906c29 (127.12.1.2:34923)
I20261115 14:57:41.117266 12292 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.013064183s
I20261115 14:57:41.118250 12600 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39576
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:422: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20261115 14:57:41.135618 12727 heartbeater.cc:500] Master 127.12.1.62:37561 was elected leader, sending a full tablet report...
I20261115 14:57:41.138406 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:57:41.153543 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:41.168954 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:57:41.175141 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:57:41.188277 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:41.203279 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:57:41.209436 12292 master.cc:585] Master@127.12.1.62:37561 shutting down...
I20261115 14:57:41.223838 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:41.224378 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:41.224779 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 23b06b50a6f944dbac496ca4230e06d1: stopping tablet replica
I20261115 14:57:41.242681 12292 master.cc:607] Master@127.12.1.62:37561 shutdown complete.
[  SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (567 ms)
[ RUN      ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20261115 14:57:41.264034 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:40181
I20261115 14:57:41.265131 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:41.269606 12815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:41.270825 12816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:41.272338 12818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.272965 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:41.273681 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:41.273844 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:41.274037 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754661274002 us; error 0 us; skew 500 ppm
I20261115 14:57:41.274552 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:41.276832 12292 webserver.cc:577] Webserver started at http://127.12.1.62:39317/ using document root <none> and password file <none>
I20261115 14:57:41.277293 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:41.277482 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:41.277748 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:41.278789 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "8b739e95982c4f25afba2b18768272a4"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.283099 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20261115 14:57:41.286315 12823 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.287015 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20261115 14:57:41.287290 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "8b739e95982c4f25afba2b18768272a4"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.287545 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:41.318135 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:41.319186 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:41.351686 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:40181
I20261115 14:57:41.351784 12874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:40181 every 8 connection(s)
I20261115 14:57:41.355412 12875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:41.364910 12875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4: Bootstrap starting.
I20261115 14:57:41.369050 12875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:41.372709 12875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4: No bootstrap required, opened a new log
I20261115 14:57:41.374709 12875 raft_consensus.cc:360] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER }
I20261115 14:57:41.375444 12875 raft_consensus.cc:386] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:41.375777 12875 raft_consensus.cc:748] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b739e95982c4f25afba2b18768272a4, State: Initialized, Role: FOLLOWER
I20261115 14:57:41.376430 12875 consensus_queue.cc:261] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER }
I20261115 14:57:41.376925 12875 raft_consensus.cc:400] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:57:41.377206 12875 raft_consensus.cc:499] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:57:41.377494 12875 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:41.381560 12875 raft_consensus.cc:521] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER }
I20261115 14:57:41.382071 12875 leader_election.cc:304] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b739e95982c4f25afba2b18768272a4; no voters: 
I20261115 14:57:41.383188 12875 leader_election.cc:290] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:57:41.383474 12878 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:41.384773 12878 raft_consensus.cc:705] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 1 LEADER]: Becoming Leader. State: Replica: 8b739e95982c4f25afba2b18768272a4, State: Running, Role: LEADER
I20261115 14:57:41.385416 12878 consensus_queue.cc:238] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER }
I20261115 14:57:41.385931 12875 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:41.387915 12879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b739e95982c4f25afba2b18768272a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER } }
I20261115 14:57:41.387923 12880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b739e95982c4f25afba2b18768272a4. Latest consensus state: current_term: 1 leader_uuid: "8b739e95982c4f25afba2b18768272a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b739e95982c4f25afba2b18768272a4" member_type: VOTER } }
I20261115 14:57:41.388548 12879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:41.388810 12880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:41.396672 12883 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:41.401482 12883 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:41.407183 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:41.411000 12883 catalog_manager.cc:1398] Generated new cluster ID: a8f5c9bbcf664200861262dfadde39ef
I20261115 14:57:41.411302 12883 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:41.431298 12883 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:41.432544 12883 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:41.444613 12883 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4: Generated new TSK 0
I20261115 14:57:41.445211 12883 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:41.474651 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:41.480360 12896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:41.481729 12897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.484910 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:41.484900 12899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.485976 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:41.486147 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:41.486263 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754661486252 us; error 0 us; skew 500 ppm
I20261115 14:57:41.486863 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:41.489355 12292 webserver.cc:577] Webserver started at http://127.12.1.1:36077/ using document root <none> and password file <none>
I20261115 14:57:41.489794 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:41.489955 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:41.490163 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:41.491142 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "2e9181244337461ba2021a45bc081e83"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.495332 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:41.498399 12904 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.499136 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:41.499456 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "2e9181244337461ba2021a45bc081e83"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.499857 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:41.519012 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:41.520154 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:41.521533 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:41.523728 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:41.523959 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.524227 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:41.524405 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.560328 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:38289
I20261115 14:57:41.560436 12966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:38289 every 8 connection(s)
I20261115 14:57:41.565133 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:41.571138 12971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:41.572170 12972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.579617 12967 heartbeater.cc:345] Connected to a master server at 127.12.1.62:40181
I20261115 14:57:41.580011 12967 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:41.580127 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:41.580240 12974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:41.581086 12967 heartbeater.cc:508] Master 127.12.1.62:40181 requested a full tablet report, sending...
I20261115 14:57:41.581296 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:41.581575 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:41.581761 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754661581731 us; error 0 us; skew 500 ppm
I20261115 14:57:41.582473 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:41.583364 12840 ts_manager.cc:210] Registered new tserver with Master: 2e9181244337461ba2021a45bc081e83 (127.12.1.1:38289)
I20261115 14:57:41.585079 12292 webserver.cc:577] Webserver started at http://127.12.1.2:40893/ using document root <none> and password file <none>
I20261115 14:57:41.585554 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:41.585543 12840 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56050
I20261115 14:57:41.585875 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:41.586164 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:41.587364 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "367fef3ca95048ea8de45bc8492f0e68"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.591763 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:41.594933 12979 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.595659 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:41.595964 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "367fef3ca95048ea8de45bc8492f0e68"
format_stamp: "Formatted at 2026-11-15 14:57:41 on dist-test-slave-fhcn"
I20261115 14:57:41.596309 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:41.605319 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:41.606283 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:41.607609 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:41.609722 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:41.609915 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.610179 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:41.610335 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:41.646433 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:40039
I20261115 14:57:41.646521 13041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:40039 every 8 connection(s)
I20261115 14:57:41.658986 13042 heartbeater.cc:345] Connected to a master server at 127.12.1.62:40181
I20261115 14:57:41.659358 13042 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:41.659996 13042 heartbeater.cc:508] Master 127.12.1.62:40181 requested a full tablet report, sending...
I20261115 14:57:41.661962 12840 ts_manager.cc:210] Registered new tserver with Master: 367fef3ca95048ea8de45bc8492f0e68 (127.12.1.2:40039)
I20261115 14:57:41.662600 12292 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.013121374s
I20261115 14:57:41.663280 12840 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56056
I20261115 14:57:41.683550 12840 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56066:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20261115 14:57:41.684964 12840 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20261115 14:57:41.688199 12967 heartbeater.cc:500] Master 127.12.1.62:40181 was elected leader, sending a full tablet report...
I20261115 14:57:41.717886 13007 tablet_service.cc:1500] Processing CreateTablet for tablet f7e5281b01e44e9fa6acf0079ae05980 (DEFAULT_TABLE table=test-table [id=b52fa4b0e1bf416e8d8b1117a449477c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:41.719228 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e5281b01e44e9fa6acf0079ae05980. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:41.719450 12932 tablet_service.cc:1500] Processing CreateTablet for tablet f7e5281b01e44e9fa6acf0079ae05980 (DEFAULT_TABLE table=test-table [id=b52fa4b0e1bf416e8d8b1117a449477c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:41.720569 12932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e5281b01e44e9fa6acf0079ae05980. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:41.730559 13055 tablet_bootstrap.cc:492] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: Bootstrap starting.
I20261115 14:57:41.731550 13056 tablet_bootstrap.cc:492] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: Bootstrap starting.
I20261115 14:57:41.736444 13055 tablet_bootstrap.cc:654] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:41.736804 13056 tablet_bootstrap.cc:654] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:41.740720 13055 tablet_bootstrap.cc:492] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: No bootstrap required, opened a new log
I20261115 14:57:41.741087 13056 tablet_bootstrap.cc:492] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: No bootstrap required, opened a new log
I20261115 14:57:41.741107 13055 ts_tablet_manager.cc:1449] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
I20261115 14:57:41.741513 13056 ts_tablet_manager.cc:1449] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20261115 14:57:41.743571 13055 raft_consensus.cc:360] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.743695 13056 raft_consensus.cc:360] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.744062 13055 raft_consensus.cc:748] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367fef3ca95048ea8de45bc8492f0e68, State: Initialized, Role: FOLLOWER
I20261115 14:57:41.744243 13056 raft_consensus.cc:748] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Initialized, Role: FOLLOWER
I20261115 14:57:41.744678 13055 consensus_queue.cc:261] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.744762 13056 consensus_queue.cc:261] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.746791 13042 heartbeater.cc:500] Master 127.12.1.62:40181 was elected leader, sending a full tablet report...
I20261115 14:57:41.747296 13055 ts_tablet_manager.cc:1480] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20261115 14:57:41.747376 13056 ts_tablet_manager.cc:1480] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20261115 14:57:41.779137 12292 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20261115 14:57:41.779342 12292 raft_consensus.cc:425] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 0 FOLLOWER]: Emulating election...
I20261115 14:57:41.779537 12292 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:41.783318 12292 raft_consensus.cc:705] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 1 LEADER]: Becoming Leader. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Running, Role: LEADER
W20261115 14:57:41.783718 12967 heartbeater.cc:648] Failed to heartbeat to 127.12.1.62:40181 (0 consecutive failures): IO error: failing all heartbeats for tests
I20261115 14:57:41.783910 12292 consensus_queue.cc:238] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.787324 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:41.799495 13017 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:41.807013 13060 consensus_queue.cc:1049] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:41.813687 12292 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20261115 14:57:41.813966 12292 raft_consensus.cc:425] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 1 LEADER]: Emulating election...
I20261115 14:57:41.814253 12292 raft_consensus.cc:3091] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:41.814499 12292 raft_consensus.cc:748] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Running, Role: LEADER
I20261115 14:57:41.814989 12292 consensus_queue.cc:261] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.815567 12292 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:41.819905 12292 raft_consensus.cc:705] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 2 LEADER]: Becoming Leader. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Running, Role: LEADER
I20261115 14:57:41.820464 12292 consensus_queue.cc:238] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.821794 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:41.823971 13017 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:41.829175 13017 raft_consensus.cc:1285] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 2 FOLLOWER]: Refusing update from remote peer 2e9181244337461ba2021a45bc081e83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20261115 14:57:41.830325 13060 consensus_queue.cc:1049] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261115 14:57:41.830770 12292 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20261115 14:57:41.935781 12292 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20261115 14:57:41.935992 12292 raft_consensus.cc:425] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 2 LEADER]: Emulating election...
I20261115 14:57:41.936249 12292 raft_consensus.cc:3091] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 2 LEADER]: Stepping down as leader of term 2
I20261115 14:57:41.936408 12292 raft_consensus.cc:748] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Running, Role: LEADER
I20261115 14:57:41.936767 12292 consensus_queue.cc:261] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.937310 12292 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:41.940982 12292 raft_consensus.cc:705] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 3 LEADER]: Becoming Leader. State: Replica: 2e9181244337461ba2021a45bc081e83, State: Running, Role: LEADER
I20261115 14:57:41.941478 12292 consensus_queue.cc:238] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 } } peers { permanent_uuid: "2e9181244337461ba2021a45bc081e83" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38289 } }
I20261115 14:57:41.942811 12292 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20261115 14:57:41.944561 13016 raft_consensus.cc:3096] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:41.949326 13016 raft_consensus.cc:1285] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 3 FOLLOWER]: Refusing update from remote peer 2e9181244337461ba2021a45bc081e83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20261115 14:57:41.950603 13067 consensus_queue.cc:1049] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367fef3ca95048ea8de45bc8492f0e68" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:41.950860 12292 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20261115 14:57:42.057979 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:57:42.074743 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:42.075587 12292 tablet_replica.cc:333] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83: stopping tablet replica
I20261115 14:57:42.076193 12292 raft_consensus.cc:2261] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 3 LEADER]: Raft consensus shutting down.
I20261115 14:57:42.076784 12292 raft_consensus.cc:2290] T f7e5281b01e44e9fa6acf0079ae05980 P 2e9181244337461ba2021a45bc081e83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:42.095764 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:57:42.103433 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:57:42.118224 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:42.119060 12292 tablet_replica.cc:333] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68: stopping tablet replica
I20261115 14:57:42.119565 12292 raft_consensus.cc:2261] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20261115 14:57:42.120002 12292 raft_consensus.cc:2290] T f7e5281b01e44e9fa6acf0079ae05980 P 367fef3ca95048ea8de45bc8492f0e68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:42.138312 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:57:42.145622 12292 master.cc:585] Master@127.12.1.62:40181 shutting down...
I20261115 14:57:42.159490 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:42.160013 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:42.160422 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8b739e95982c4f25afba2b18768272a4: stopping tablet replica
I20261115 14:57:42.177994 12292 master.cc:607] Master@127.12.1.62:40181 shutdown complete.
[       OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (936 ms)
[----------] 3 tests from LeadershipChangeReportingTest (5510 ms total)

[----------] 4 tests from TsTabletManagerITest
[ RUN      ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20261115 14:57:42.201517 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:45403
I20261115 14:57:42.202518 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:42.207127 13072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.208454 13073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.209775 13075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:42.210536 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:42.211443 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:42.211639 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:42.211822 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754662211788 us; error 0 us; skew 500 ppm
I20261115 14:57:42.212481 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:42.214705 12292 webserver.cc:577] Webserver started at http://127.12.1.62:45705/ using document root <none> and password file <none>
I20261115 14:57:42.215202 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:42.215394 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:42.215665 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:42.216778 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "88d9562443684c49ade3920d529fdba2"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.221192 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:57:42.224386 13080 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.225088 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261115 14:57:42.225378 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "88d9562443684c49ade3920d529fdba2"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.225651 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:42.258896 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:42.259924 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:42.293628 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:45403
I20261115 14:57:42.293680 13131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:45403 every 8 connection(s)
I20261115 14:57:42.297302 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:42.306602 13132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2: Bootstrap starting.
I20261115 14:57:42.310793 13132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:42.314518 13132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2: No bootstrap required, opened a new log
I20261115 14:57:42.317039 13132 raft_consensus.cc:360] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER }
I20261115 14:57:42.317448 13132 raft_consensus.cc:386] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:42.317621 13132 raft_consensus.cc:748] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d9562443684c49ade3920d529fdba2, State: Initialized, Role: FOLLOWER
I20261115 14:57:42.318161 13132 consensus_queue.cc:261] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER }
I20261115 14:57:42.318580 13132 raft_consensus.cc:400] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:57:42.318765 13132 raft_consensus.cc:499] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:57:42.318962 13132 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:42.322930 13132 raft_consensus.cc:521] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER }
I20261115 14:57:42.323383 13132 leader_election.cc:304] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88d9562443684c49ade3920d529fdba2; no voters: 
I20261115 14:57:42.324429 13132 leader_election.cc:290] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:57:42.324712 13135 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:42.326022 13135 raft_consensus.cc:705] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 1 LEADER]: Becoming Leader. State: Replica: 88d9562443684c49ade3920d529fdba2, State: Running, Role: LEADER
I20261115 14:57:42.326709 13135 consensus_queue.cc:238] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER }
I20261115 14:57:42.327222 13132 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:42.329607 13136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88d9562443684c49ade3920d529fdba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER } }
I20261115 14:57:42.329643 13137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88d9562443684c49ade3920d529fdba2. Latest consensus state: current_term: 1 leader_uuid: "88d9562443684c49ade3920d529fdba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d9562443684c49ade3920d529fdba2" member_type: VOTER } }
I20261115 14:57:42.330431 13137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:42.330449 13136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:42.333732 13140 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:42.338728 13140 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:42.343158 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:42.347951 13140 catalog_manager.cc:1398] Generated new cluster ID: 0729f52962d94b328f0741f6bcf052e0
I20261115 14:57:42.348285 13140 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:42.369851 13140 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:42.371045 13140 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:42.381827 13140 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2: Generated new TSK 0
I20261115 14:57:42.382417 13140 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:42.409524 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:42.415042 13153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.416261 13154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.417579 13156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:42.418372 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:42.419142 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:42.419363 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:42.419495 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754662419483 us; error 0 us; skew 500 ppm
I20261115 14:57:42.419930 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:42.422080 12292 webserver.cc:577] Webserver started at http://127.12.1.1:38585/ using document root <none> and password file <none>
I20261115 14:57:42.422518 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:42.422673 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:42.422880 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:42.423872 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "9d3ec95c5267425c93020bbb8b6fb607"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.428282 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20261115 14:57:42.431461 13161 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.432297 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:42.432586 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "9d3ec95c5267425c93020bbb8b6fb607"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.432869 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:42.445834 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:42.446833 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:42.448256 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:42.450346 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:42.450572 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.450809 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:42.450973 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.486455 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:37589
I20261115 14:57:42.486532 13223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:37589 every 8 connection(s)
I20261115 14:57:42.491164 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:42.497210 13228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.499507 13229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:42.501950 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:42.502810 13231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:42.503796 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20261115 14:57:42.503811 13224 heartbeater.cc:345] Connected to a master server at 127.12.1.62:45403
W20261115 14:57:42.504048 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:42.504273 13224 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:42.504314 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754662504295 us; error 0 us; skew 500 ppm
I20261115 14:57:42.505007 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:42.505070 13224 heartbeater.cc:508] Master 127.12.1.62:45403 requested a full tablet report, sending...
I20261115 14:57:42.507146 13097 ts_manager.cc:210] Registered new tserver with Master: 9d3ec95c5267425c93020bbb8b6fb607 (127.12.1.1:37589)
I20261115 14:57:42.507840 12292 webserver.cc:577] Webserver started at http://127.12.1.2:37745/ using document root <none> and password file <none>
I20261115 14:57:42.508354 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:42.508564 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:42.508826 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:42.508970 13097 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41828
I20261115 14:57:42.510039 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "579a4a5bf020434687daec6e6290db65"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.514290 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:42.517552 13236 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.518435 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261115 14:57:42.518679 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "579a4a5bf020434687daec6e6290db65"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.518908 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:42.552139 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:42.553121 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:42.554463 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:42.556650 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:42.556857 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.557142 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:42.557299 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.593354 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:40911
I20261115 14:57:42.593438 13298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:40911 every 8 connection(s)
I20261115 14:57:42.598104 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:42.604732 13302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.605525 13303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:42.607517 13305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:42.608965 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:42.610021 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:42.610278 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:42.610469 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754662610452 us; error 0 us; skew 500 ppm
I20261115 14:57:42.610668 13299 heartbeater.cc:345] Connected to a master server at 127.12.1.62:45403
I20261115 14:57:42.611029 13299 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:42.611066 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:42.611845 13299 heartbeater.cc:508] Master 127.12.1.62:45403 requested a full tablet report, sending...
I20261115 14:57:42.613771 12292 webserver.cc:577] Webserver started at http://127.12.1.3:45115/ using document root <none> and password file <none>
I20261115 14:57:42.613951 13097 ts_manager.cc:210] Registered new tserver with Master: 579a4a5bf020434687daec6e6290db65 (127.12.1.2:40911)
I20261115 14:57:42.614392 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:42.614646 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:42.614957 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:42.615706 13097 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41830
I20261115 14:57:42.616361 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-2-root/instance:
uuid: "ee7605f00259419ea31dbd3f45049d4f"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.621148 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20261115 14:57:42.624191 13310 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.624862 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:42.625151 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-2-root
uuid: "ee7605f00259419ea31dbd3f45049d4f"
format_stamp: "Formatted at 2026-11-15 14:57:42 on dist-test-slave-fhcn"
I20261115 14:57:42.625437 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1794754656521719-12292-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:42.646673 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:42.647733 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:42.649159 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:42.651209 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:42.651432 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.651674 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:42.651850 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:42.714952 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.3:42083
I20261115 14:57:42.715044 13372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.3:42083 every 8 connection(s)
I20261115 14:57:42.730454 13373 heartbeater.cc:345] Connected to a master server at 127.12.1.62:45403
I20261115 14:57:42.730798 13373 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:42.731492 13373 heartbeater.cc:508] Master 127.12.1.62:45403 requested a full tablet report, sending...
I20261115 14:57:42.733517 13097 ts_manager.cc:210] Registered new tserver with Master: ee7605f00259419ea31dbd3f45049d4f (127.12.1.3:42083)
I20261115 14:57:42.734589 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014593694s
I20261115 14:57:42.734997 13097 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41834
I20261115 14:57:42.758425 13097 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41838:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
  }
}
W20261115 14:57:42.759687 13097 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261115 14:57:42.801669 13264 tablet_service.cc:1500] Processing CreateTablet for tablet 39c3e53fe26c40a5847a4b621c03da1c (DEFAULT_TABLE table=test-table [id=52f5eb5860554fbebfbe8b050629485c]), partition=
I20261115 14:57:42.802503 13189 tablet_service.cc:1500] Processing CreateTablet for tablet 39c3e53fe26c40a5847a4b621c03da1c (DEFAULT_TABLE table=test-table [id=52f5eb5860554fbebfbe8b050629485c]), partition=
I20261115 14:57:42.802778 13264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c3e53fe26c40a5847a4b621c03da1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:42.803602 13189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c3e53fe26c40a5847a4b621c03da1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:42.809249 13338 tablet_service.cc:1500] Processing CreateTablet for tablet 39c3e53fe26c40a5847a4b621c03da1c (DEFAULT_TABLE table=test-table [id=52f5eb5860554fbebfbe8b050629485c]), partition=
I20261115 14:57:42.810297 13338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c3e53fe26c40a5847a4b621c03da1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:42.816669 13388 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: Bootstrap starting.
I20261115 14:57:42.821393 13389 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: Bootstrap starting.
I20261115 14:57:42.823063 13388 tablet_bootstrap.cc:654] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:42.829293 13390 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: Bootstrap starting.
I20261115 14:57:42.829797 13388 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: No bootstrap required, opened a new log
I20261115 14:57:42.830273 13388 ts_tablet_manager.cc:1449] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20261115 14:57:42.830479 13389 tablet_bootstrap.cc:654] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:42.835590 13388 raft_consensus.cc:360] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.836496 13388 raft_consensus.cc:386] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:42.836867 13390 tablet_bootstrap.cc:654] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:42.836833 13388 raft_consensus.cc:748] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d3ec95c5267425c93020bbb8b6fb607, State: Initialized, Role: FOLLOWER
I20261115 14:57:42.837615 13389 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: No bootstrap required, opened a new log
I20261115 14:57:42.838182 13389 ts_tablet_manager.cc:1449] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20261115 14:57:42.837631 13388 consensus_queue.cc:261] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.841838 13389 raft_consensus.cc:360] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.842653 13390 tablet_bootstrap.cc:492] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: No bootstrap required, opened a new log
I20261115 14:57:42.842587 13388 ts_tablet_manager.cc:1480] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20261115 14:57:42.843734 13390 ts_tablet_manager.cc:1449] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.010s
I20261115 14:57:42.842588 13389 raft_consensus.cc:386] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:42.844026 13224 heartbeater.cc:500] Master 127.12.1.62:45403 was elected leader, sending a full tablet report...
I20261115 14:57:42.844576 13389 raft_consensus.cc:748] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 579a4a5bf020434687daec6e6290db65, State: Initialized, Role: FOLLOWER
I20261115 14:57:42.845410 13389 consensus_queue.cc:261] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.846675 13390 raft_consensus.cc:360] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.847361 13390 raft_consensus.cc:386] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:42.847663 13390 raft_consensus.cc:748] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7605f00259419ea31dbd3f45049d4f, State: Initialized, Role: FOLLOWER
I20261115 14:57:42.848438 13390 consensus_queue.cc:261] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:42.851718 13389 ts_tablet_manager.cc:1480] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.002s
I20261115 14:57:42.852414 13299 heartbeater.cc:500] Master 127.12.1.62:45403 was elected leader, sending a full tablet report...
I20261115 14:57:42.853314 13373 heartbeater.cc:500] Master 127.12.1.62:45403 was elected leader, sending a full tablet report...
I20261115 14:57:42.853864 13390 ts_tablet_manager.cc:1480] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20261115 14:57:43.011117 13396 raft_consensus.cc:499] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:43.011526 13396 raft_consensus.cc:521] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:43.013602 13396 leader_election.cc:290] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d3ec95c5267425c93020bbb8b6fb607 (127.12.1.1:37589), 579a4a5bf020434687daec6e6290db65 (127.12.1.2:40911)
I20261115 14:57:43.023067 13199 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "39c3e53fe26c40a5847a4b621c03da1c" candidate_uuid: "ee7605f00259419ea31dbd3f45049d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d3ec95c5267425c93020bbb8b6fb607" is_pre_election: true
I20261115 14:57:43.023525 13274 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "39c3e53fe26c40a5847a4b621c03da1c" candidate_uuid: "ee7605f00259419ea31dbd3f45049d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "579a4a5bf020434687daec6e6290db65" is_pre_election: true
I20261115 14:57:43.023828 13199 raft_consensus.cc:2490] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee7605f00259419ea31dbd3f45049d4f in term 0.
I20261115 14:57:43.024142 13274 raft_consensus.cc:2490] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee7605f00259419ea31dbd3f45049d4f in term 0.
I20261115 14:57:43.025044 13314 leader_election.cc:304] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d3ec95c5267425c93020bbb8b6fb607, ee7605f00259419ea31dbd3f45049d4f; no voters: 
I20261115 14:57:43.025775 13396 raft_consensus.cc:2826] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:43.026022 13396 raft_consensus.cc:499] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:43.026271 13396 raft_consensus.cc:3096] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:43.031026 13396 raft_consensus.cc:521] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:43.032795 13396 leader_election.cc:290] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [CANDIDATE]: Term 1 election: Requested vote from peers 9d3ec95c5267425c93020bbb8b6fb607 (127.12.1.1:37589), 579a4a5bf020434687daec6e6290db65 (127.12.1.2:40911)
I20261115 14:57:43.033624 13199 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "39c3e53fe26c40a5847a4b621c03da1c" candidate_uuid: "ee7605f00259419ea31dbd3f45049d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d3ec95c5267425c93020bbb8b6fb607"
I20261115 14:57:43.033900 13274 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "39c3e53fe26c40a5847a4b621c03da1c" candidate_uuid: "ee7605f00259419ea31dbd3f45049d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "579a4a5bf020434687daec6e6290db65"
I20261115 14:57:43.034133 13199 raft_consensus.cc:3096] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:43.034437 13274 raft_consensus.cc:3096] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:43.039353 13199 raft_consensus.cc:2490] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee7605f00259419ea31dbd3f45049d4f in term 1.
I20261115 14:57:43.039568 13274 raft_consensus.cc:2490] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee7605f00259419ea31dbd3f45049d4f in term 1.
I20261115 14:57:43.040436 13314 leader_election.cc:304] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d3ec95c5267425c93020bbb8b6fb607, ee7605f00259419ea31dbd3f45049d4f; no voters: 
I20261115 14:57:43.041119 13396 raft_consensus.cc:2826] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:43.041958 13396 raft_consensus.cc:705] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 1 LEADER]: Becoming Leader. State: Replica: ee7605f00259419ea31dbd3f45049d4f, State: Running, Role: LEADER
I20261115 14:57:43.042624 13396 consensus_queue.cc:238] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } }
I20261115 14:57:43.050150 13400 consensus_queue.cc:1049] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:57:43.050256 13095 catalog_manager.cc:5840] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee7605f00259419ea31dbd3f45049d4f (127.12.1.3). New cstate: current_term: 1 leader_uuid: "ee7605f00259419ea31dbd3f45049d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d3ec95c5267425c93020bbb8b6fb607" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 37589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee7605f00259419ea31dbd3f45049d4f" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 42083 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:43.050956 13396 consensus_queue.cc:1049] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "579a4a5bf020434687daec6e6290db65" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 40911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:48.159298 12292 tablet_replica.cc:333] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607: stopping tablet replica
I20261115 14:57:48.160331 12292 raft_consensus.cc:2261] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:57:48.160866 12292 raft_consensus.cc:2290] T 39c3e53fe26c40a5847a4b621c03da1c P 9d3ec95c5267425c93020bbb8b6fb607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:48.644603 13314 consensus_queue.cc:580] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [LEADER]: The tablet replica hosted on peer 9d3ec95c5267425c93020bbb8b6fb607 has failed
W20261115 14:57:48.645102 13314 consensus_peers.cc:597] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f -> Peer 9d3ec95c5267425c93020bbb8b6fb607 (127.12.1.1:37589): Couldn't send request to peer 9d3ec95c5267425c93020bbb8b6fb607. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:57:48.689649 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:57:48.714262 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:48.732754 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:57:48.743468 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:57:48.762073 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:48.762848 12292 tablet_replica.cc:333] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65: stopping tablet replica
I20261115 14:57:48.763489 12292 raft_consensus.cc:2261] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:57:48.763967 12292 raft_consensus.cc:2290] T 39c3e53fe26c40a5847a4b621c03da1c P 579a4a5bf020434687daec6e6290db65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:48.782656 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:57:48.791917 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
I20261115 14:57:48.809969 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:48.810633 12292 tablet_replica.cc:333] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f: stopping tablet replica
I20261115 14:57:48.811115 12292 raft_consensus.cc:2261] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:48.811767 12292 raft_consensus.cc:2290] T 39c3e53fe26c40a5847a4b621c03da1c P ee7605f00259419ea31dbd3f45049d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:48.830211 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:57:48.839906 12292 master.cc:585] Master@127.12.1.62:45403 shutting down...
I20261115 14:57:48.859460 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:48.860183 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:48.860515 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88d9562443684c49ade3920d529fdba2: stopping tablet replica
I20261115 14:57:48.878321 12292 master.cc:607] Master@127.12.1.62:45403 shutdown complete.
[       OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (6708 ms)
[ RUN      ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20261115 14:57:48.910135 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:36831
I20261115 14:57:48.911370 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:48.917188 13414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:48.917989 13415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:48.920315 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:48.920723 13417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:48.921482 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:48.921701 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:48.921890 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754668921856 us; error 0 us; skew 500 ppm
I20261115 14:57:48.922433 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:48.924955 12292 webserver.cc:577] Webserver started at http://127.12.1.62:45609/ using document root <none> and password file <none>
I20261115 14:57:48.925455 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:48.925652 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:48.925932 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:48.927086 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "791ef5316dfc4c638bdf4100c030cf14"
format_stamp: "Formatted at 2026-11-15 14:57:48 on dist-test-slave-fhcn"
I20261115 14:57:48.931509 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20261115 14:57:48.934722 13422 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:48.935407 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:48.935698 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "791ef5316dfc4c638bdf4100c030cf14"
format_stamp: "Formatted at 2026-11-15 14:57:48 on dist-test-slave-fhcn"
I20261115 14:57:48.935963 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:48.951421 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:48.952672 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:48.990268 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:36831
I20261115 14:57:48.990374 13473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:36831 every 8 connection(s)
I20261115 14:57:48.994100 13474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:49.004335 13474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14: Bootstrap starting.
I20261115 14:57:49.009311 13474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:49.013523 13474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14: No bootstrap required, opened a new log
I20261115 14:57:49.015591 13474 raft_consensus.cc:360] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER }
I20261115 14:57:49.015959 13474 raft_consensus.cc:386] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:49.016237 13474 raft_consensus.cc:748] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791ef5316dfc4c638bdf4100c030cf14, State: Initialized, Role: FOLLOWER
I20261115 14:57:49.016788 13474 consensus_queue.cc:261] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER }
I20261115 14:57:49.017187 13474 raft_consensus.cc:400] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:57:49.017371 13474 raft_consensus.cc:499] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:57:49.017573 13474 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:49.021767 13474 raft_consensus.cc:521] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER }
I20261115 14:57:49.022193 13474 leader_election.cc:304] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 791ef5316dfc4c638bdf4100c030cf14; no voters: 
I20261115 14:57:49.023203 13474 leader_election.cc:290] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:57:49.023597 13477 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:49.024935 13477 raft_consensus.cc:705] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 1 LEADER]: Becoming Leader. State: Replica: 791ef5316dfc4c638bdf4100c030cf14, State: Running, Role: LEADER
I20261115 14:57:49.025507 13477 consensus_queue.cc:238] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER }
I20261115 14:57:49.026139 13474 sys_catalog.cc:565] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:49.028213 13478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "791ef5316dfc4c638bdf4100c030cf14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER } }
I20261115 14:57:49.028333 13479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 791ef5316dfc4c638bdf4100c030cf14. Latest consensus state: current_term: 1 leader_uuid: "791ef5316dfc4c638bdf4100c030cf14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791ef5316dfc4c638bdf4100c030cf14" member_type: VOTER } }
I20261115 14:57:49.028964 13479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:49.028947 13478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:49.033408 13482 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:49.038743 13482 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:49.040997 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:49.047452 13482 catalog_manager.cc:1398] Generated new cluster ID: bda8fa80c54c43a58cb0a8f30d6adcf6
I20261115 14:57:49.047753 13482 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:49.066020 13482 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:49.067303 13482 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:49.083946 13482 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14: Generated new TSK 0
I20261115 14:57:49.084582 13482 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:49.107121 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:49.113341 13495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.114302 13496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.116281 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:49.116477 13498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.117414 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:49.117602 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:49.117841 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754669117806 us; error 0 us; skew 500 ppm
I20261115 14:57:49.118443 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:49.121114 12292 webserver.cc:577] Webserver started at http://127.12.1.1:35721/ using document root <none> and password file <none>
I20261115 14:57:49.121616 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:49.121815 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:49.122090 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:49.123200 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "10b833a4e240451a977c85f21f133233"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.128003 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:49.131420 13503 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.132248 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:49.132547 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "10b833a4e240451a977c85f21f133233"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.132822 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:49.156925 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:49.158224 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:49.159813 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:49.162698 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:49.162914 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.163218 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:49.163393 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.202625 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:46273
I20261115 14:57:49.202719 13565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:46273 every 8 connection(s)
I20261115 14:57:49.217350 13566 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36831
I20261115 14:57:49.217721 13566 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:49.218446 13566 heartbeater.cc:508] Master 127.12.1.62:36831 requested a full tablet report, sending...
I20261115 14:57:49.220530 13439 ts_manager.cc:210] Registered new tserver with Master: 10b833a4e240451a977c85f21f133233 (127.12.1.1:46273)
I20261115 14:57:49.220793 12292 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015086302s
I20261115 14:57:49.222409 13439 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53982
I20261115 14:57:49.240893 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:57:49.255674 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:49.271000 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:57:49.278564 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261115 14:57:49.281528 12292 tablet_server.cc:94] deduplicated master addresses: 127.12.1.62:36831
W20261115 14:57:49.284876 13576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.285316 13577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.286684 13579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.287537 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:49.288388 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:49.288586 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:49.288756 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754669288720 us; error 0 us; skew 500 ppm
I20261115 14:57:49.289285 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:49.291420 12292 webserver.cc:577] Webserver started at http://127.12.1.1:35721/ using document root <none> and password file <none>
I20261115 14:57:49.291895 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:49.292070 12292 fs_manager.cc:365] Using existing metadata directory in first data directory
I20261115 14:57:49.295503 12292 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.002s
I20261115 14:57:49.298132 13584 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.298885 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:49.299170 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "10b833a4e240451a977c85f21f133233"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.299441 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:49.319712 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:49.320902 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:49.322433 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:49.324704 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:49.324882 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.325178 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:49.325340 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.361033 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:46273
I20261115 14:57:49.361120 13646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:46273 every 8 connection(s)
I20261115 14:57:49.365971 12292 tablet_server.cc:179] TabletServer@127.12.1.1:46273 shutting down...
I20261115 14:57:49.385262 13647 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36831
I20261115 14:57:49.385959 13647 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:49.386751 13647 heartbeater.cc:508] Master 127.12.1.62:36831 requested a full tablet report, sending...
I20261115 14:57:49.388872 13439 ts_manager.cc:210] Re-registered known tserver with Master: 10b833a4e240451a977c85f21f133233 (127.12.1.1:46273)
I20261115 14:57:49.390157 13439 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53990
I20261115 14:57:49.392470 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:57:49.407518 12292 tablet_server.cc:196] TabletServer@127.12.1.1:46273 shutdown complete.
I20261115 14:57:49.414426 12292 master.cc:585] Master@127.12.1.62:36831 shutting down...
I20261115 14:57:49.427078 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:57:49.427635 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:49.428234 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 791ef5316dfc4c638bdf4100c030cf14: stopping tablet replica
I20261115 14:57:49.446080 12292 master.cc:607] Master@127.12.1.62:36831 shutdown complete.
[       OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (558 ms)
[ RUN      ] TsTabletManagerITest.TestTableStats
I20261115 14:57:49.468292 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:35143,127.12.1.61:44723,127.12.1.60:43497
I20261115 14:57:49.469578 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:49.474380 13654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.475229 13655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.476971 13657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.477129 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:49.477933 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:49.478106 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:49.478221 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754669478210 us; error 0 us; skew 500 ppm
I20261115 14:57:49.478672 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:49.481069 12292 webserver.cc:577] Webserver started at http://127.12.1.62:46881/ using document root <none> and password file <none>
I20261115 14:57:49.481499 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:49.481650 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:49.481861 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:49.482882 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "20af9b506c3c4202822898b70849d240"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.487457 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:49.490753 13662 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.491488 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:49.491783 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "20af9b506c3c4202822898b70849d240"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.492062 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:49.512748 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:49.513746 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:49.548261 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:35143
I20261115 14:57:49.548348 13713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:35143 every 8 connection(s)
I20261115 14:57:49.551967 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:49.552187 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:49.557515 13716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.559124 13717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.559646 13714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
W20261115 14:57:49.560297 13719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.561085 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:49.561996 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:49.562260 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:49.562517 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754669562487 us; error 0 us; skew 500 ppm
I20261115 14:57:49.563341 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:49.566305 12292 webserver.cc:577] Webserver started at http://127.12.1.61:34691/ using document root <none> and password file <none>
I20261115 14:57:49.566777 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:49.566964 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:49.567243 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:49.568372 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root/instance:
uuid: "eb7b468eb37d4054b52193916a9a47eb"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.574334 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20261115 14:57:49.577350 13714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.578310 13726 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.579249 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261115 14:57:49.579560 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
uuid: "eb7b468eb37d4054b52193916a9a47eb"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.579850 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261115 14:57:49.580250 13664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
W20261115 14:57:49.583984 13714 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.1.61:44723: Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
I20261115 14:57:49.614708 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:49.615792 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:49.635672 13714 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } attempt: 1
W20261115 14:57:49.641232 13714 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.1.61:44723: Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
I20261115 14:57:49.653599 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.61:44723
I20261115 14:57:49.653680 13778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.61:44723 every 8 connection(s)
I20261115 14:57:49.657305 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:49.657608 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:57:49.662786 13781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.664392 13782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:49.665892 13784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:49.666213 13779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.666457 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:49.667289 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:49.667527 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:49.667737 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754669667716 us; error 0 us; skew 500 ppm
I20261115 14:57:49.668481 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:49.671327 12292 webserver.cc:577] Webserver started at http://127.12.1.60:34265/ using document root <none> and password file <none>
I20261115 14:57:49.671804 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:49.672009 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:49.672346 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:49.673363 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root/instance:
uuid: "c6a149406f4749cca582af0b8b0147f5"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.679327 13779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.681175 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20261115 14:57:49.686151 13791 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:49.687068 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20261115 14:57:49.687434 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
uuid: "c6a149406f4749cca582af0b8b0147f5"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:49.687732 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:49.692835 13779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
W20261115 14:57:49.698472 13779 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.1.60:43497: Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
I20261115 14:57:49.702764 13714 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } attempt: 2
I20261115 14:57:49.703140 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:49.704499 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:49.713027 13714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.717162 13779 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } attempt: 1
W20261115 14:57:49.718025 13714 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.1.60:43497: Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
W20261115 14:57:49.722903 13779 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.1.60:43497: Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
I20261115 14:57:49.747220 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.60:43497
I20261115 14:57:49.747325 13843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.60:43497 every 8 connection(s)
I20261115 14:57:49.750312 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:57:49.751005 13844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:49.756639 13714 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } attempt: 1
I20261115 14:57:49.756716 13844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.763455 13779 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } attempt: 2
I20261115 14:57:49.771611 13844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.778218 13714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: Bootstrap starting.
I20261115 14:57:49.784729 13779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Bootstrap starting.
I20261115 14:57:49.784858 13714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:49.792577 13779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:49.793418 13844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
I20261115 14:57:49.794492 13714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: No bootstrap required, opened a new log
I20261115 14:57:49.798250 13714 raft_consensus.cc:360] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.798985 13714 raft_consensus.cc:386] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:49.799291 13714 raft_consensus.cc:748] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20af9b506c3c4202822898b70849d240, State: Initialized, Role: FOLLOWER
I20261115 14:57:49.800101 13779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: No bootstrap required, opened a new log
I20261115 14:57:49.800092 13714 consensus_queue.cc:261] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.803889 13779 raft_consensus.cc:360] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.804976 13779 raft_consensus.cc:386] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:49.805349 13779 raft_consensus.cc:748] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7b468eb37d4054b52193916a9a47eb, State: Initialized, Role: FOLLOWER
I20261115 14:57:49.806296 13779 consensus_queue.cc:261] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.814474 13852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.815665 13852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.816157 13852 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:49.816614 13852 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.818238 13853 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.819715 13853 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.819000 13844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Bootstrap starting.
I20261115 14:57:49.820261 13779 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:49.821280 13714 sys_catalog.cc:565] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:49.822423 13754 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:57:49.823236 13754 raft_consensus.cc:2490] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 0.
I20261115 14:57:49.824899 13664 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb; no voters: 
I20261115 14:57:49.825917 13851 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:49.826367 13851 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:49.826762 13851 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:49.826943 13844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:49.827536 13852 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:49.834719 13844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: No bootstrap required, opened a new log
I20261115 14:57:49.837950 13844 raft_consensus.cc:360] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.838738 13844 raft_consensus.cc:386] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:49.839080 13844 raft_consensus.cc:748] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a149406f4749cca582af0b8b0147f5, State: Initialized, Role: FOLLOWER
I20261115 14:57:49.840044 13844 consensus_queue.cc:261] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.841100 13851 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.843039 13859 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.843894 13859 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.849205 13754 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb"
I20261115 14:57:49.849716 13754 raft_consensus.cc:3096] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:49.844142 13851 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 1 election: Requested vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:49.851824 13844 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:49.855011 13819 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:57:49.855887 13819 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 0.
I20261115 14:57:49.857246 13818 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5"
I20261115 14:57:49.857995 13818 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:49.859666 13754 raft_consensus.cc:2490] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 1.
I20261115 14:57:49.861390 13664 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb; no voters: 
I20261115 14:57:49.862607 13851 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:49.863217 13851 raft_consensus.cc:705] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 LEADER]: Becoming Leader. State: Replica: 20af9b506c3c4202822898b70849d240, State: Running, Role: LEADER
I20261115 14:57:49.865401 13851 consensus_queue.cc:238] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:49.873710 13818 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 1.
I20261115 14:57:49.881151 13852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.882174 13852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:49.908591 13867 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:49.913141 13869 consensus_queue.cc:1049] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:57:49.919298 13852 consensus_queue.cc:1049] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:57:49.942909 13867 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:49.947541 13853 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.948608 13853 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.960929 13869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.962020 13869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:49.975235 13853 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.976294 13853 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.977898 13859 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.978855 13859 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:49.985389 13869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:49.986370 13869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:49.995846 13867 catalog_manager.cc:1398] Generated new cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:49.996192 13867 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:50.017881 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20261115 14:57:50.018508 13882 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:50.019325 13882 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:50.030012 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20261115 14:57:50.031970 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261115 14:57:50.034446 12292 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20261115 14:57:50.035130 13900 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:50.035398 13900 catalog_manager.cc:1603] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: loading cluster ID for follower catalog manager: success
I20261115 14:57:50.035710 13901 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:50.036135 13901 catalog_manager.cc:1603] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: loading cluster ID for follower catalog manager: success
W20261115 14:57:50.039847 13900 catalog_manager.cc:1627] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20261115 14:57:50.040256 13900 catalog_manager.cc:898] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
W20261115 14:57:50.040680 13901 catalog_manager.cc:1627] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20261115 14:57:50.041083 13901 catalog_manager.cc:898] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20261115 14:57:50.042582 13867 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:57:50.044286 13867 catalog_manager.cc:1555] Loading token signing keys...
W20261115 14:57:50.055073 13902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:50.057241 13903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:57:50.059579 13905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.061759 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:50.062700 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:50.062947 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:50.063158 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754670063141 us; error 0 us; skew 500 ppm
I20261115 14:57:50.064571 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:50.070429 13867 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: Generated new TSK 0
I20261115 14:57:50.071018 12292 webserver.cc:577] Webserver started at http://127.12.1.1:37119/ using document root <none> and password file <none>
I20261115 14:57:50.071585 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:50.071885 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:50.072207 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:50.071089 13867 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:50.073639 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "25a1f4bd36e14df983b98a471f53f937"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.079260 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20261115 14:57:50.082692 13910 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.083514 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:50.083832 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "25a1f4bd36e14df983b98a471f53f937"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.084167 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:50.095563 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:50.096872 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:50.098316 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:50.100607 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:50.100842 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.101076 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:50.101246 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.142500 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:35611
I20261115 14:57:50.142593 13972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:35611 every 8 connection(s)
I20261115 14:57:50.160526 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261115 14:57:50.165858 12292 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20261115 14:57:50.167389 13973 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:50.167829 13973 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.168753 13973 heartbeater.cc:508] Master 127.12.1.60:43497 requested a full tablet report, sending...
I20261115 14:57:50.171875 13809 ts_manager.cc:210] Registered new tserver with Master: 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611)
W20261115 14:57:50.176971 13980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.178459 13974 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
W20261115 14:57:50.178694 13981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.178910 13974 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.179831 13974 heartbeater.cc:508] Master 127.12.1.61:44723 requested a full tablet report, sending...
I20261115 14:57:50.183629 13744 ts_manager.cc:210] Registered new tserver with Master: 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611)
I20261115 14:57:50.184566 13975 heartbeater.cc:345] Connected to a master server at 127.12.1.62:35143
I20261115 14:57:50.185036 13975 heartbeater.cc:462] Registering TS with master...
W20261115 14:57:50.185720 13983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.186039 13975 heartbeater.cc:508] Master 127.12.1.62:35143 requested a full tablet report, sending...
I20261115 14:57:50.186506 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:50.187558 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:50.187810 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:50.188020 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754670188001 us; error 0 us; skew 500 ppm
I20261115 14:57:50.188676 13679 ts_manager.cc:210] Registered new tserver with Master: 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611)
I20261115 14:57:50.188836 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:50.191220 13679 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38876
I20261115 14:57:50.191824 12292 webserver.cc:577] Webserver started at http://127.12.1.2:38129/ using document root <none> and password file <none>
I20261115 14:57:50.192466 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:50.192719 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:50.193054 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:50.194558 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.199065 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:57:50.202677 13988 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.203554 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:57:50.203945 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.204360 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:50.225358 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:50.226661 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:50.227890 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:50.229885 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:50.230118 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.230360 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:50.230535 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.294440 13975 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:50.306489 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:46463
I20261115 14:57:50.306594 14050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:46463 every 8 connection(s)
I20261115 14:57:50.317857 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261115 14:57:50.320840 12292 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20261115 14:57:50.331650 14052 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
I20261115 14:57:50.332163 14052 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.333082 14052 heartbeater.cc:508] Master 127.12.1.61:44723 requested a full tablet report, sending...
I20261115 14:57:50.335243 14051 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:50.335575 14051 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.336467 14051 heartbeater.cc:508] Master 127.12.1.60:43497 requested a full tablet report, sending...
I20261115 14:57:50.336565 13744 ts_manager.cc:210] Registered new tserver with Master: 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.339720 13809 ts_manager.cc:210] Registered new tserver with Master: 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.343884 14053 heartbeater.cc:345] Connected to a master server at 127.12.1.62:35143
I20261115 14:57:50.344250 14053 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.345276 14053 heartbeater.cc:508] Master 127.12.1.62:35143 requested a full tablet report, sending...
W20261115 14:57:50.345484 14059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.347553 13679 ts_manager.cc:210] Registered new tserver with Master: 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
W20261115 14:57:50.347647 14058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.349591 13679 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38884
W20261115 14:57:50.351035 14061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:50.351092 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:50.352319 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:50.352502 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:50.352634 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754670352623 us; error 0 us; skew 500 ppm
I20261115 14:57:50.353150 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:50.355379 12292 webserver.cc:577] Webserver started at http://127.12.1.3:34873/ using document root <none> and password file <none>
I20261115 14:57:50.355787 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:50.355942 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:57:50.356226 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:57:50.357314 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-2-root/instance:
uuid: "70a8e5bf3f114973a6c79283747a896e"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.361788 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20261115 14:57:50.365070 14066 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.365880 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:57:50.366251 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-2-root
uuid: "70a8e5bf3f114973a6c79283747a896e"
format_stamp: "Formatted at 2026-11-15 14:57:50 on dist-test-slave-fhcn"
I20261115 14:57:50.366540 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:50.389147 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:50.390790 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:50.393184 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:57:50.395949 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:57:50.396232 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.396495 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:57:50.396653 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:50.452312 14053 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:50.478653 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.3:38363
I20261115 14:57:50.478751 14128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.3:38363 every 8 connection(s)
I20261115 14:57:50.500474 14129 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:50.501019 14129 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.502324 14129 heartbeater.cc:508] Master 127.12.1.60:43497 requested a full tablet report, sending...
I20261115 14:57:50.505455 13809 ts_manager.cc:210] Registered new tserver with Master: 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.510761 14130 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
I20261115 14:57:50.511194 14130 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.512269 14130 heartbeater.cc:508] Master 127.12.1.61:44723 requested a full tablet report, sending...
I20261115 14:57:50.514999 13744 ts_manager.cc:210] Registered new tserver with Master: 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.515239 14132 heartbeater.cc:345] Connected to a master server at 127.12.1.62:35143
I20261115 14:57:50.515623 14132 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:50.516512 14132 heartbeater.cc:508] Master 127.12.1.62:35143 requested a full tablet report, sending...
I20261115 14:57:50.518522 13679 ts_manager.cc:210] Registered new tserver with Master: 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.518731 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022201463s
I20261115 14:57:50.520175 13679 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38888
I20261115 14:57:50.551061 13679 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38896:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  hash_schema {
    columns {
      name: "key"
    }
    num_buckets: 3
    seed: 0
  }
}
W20261115 14:57:50.553469 13679 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261115 14:57:50.623939 14132 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:50.629021 13938 tablet_service.cc:1500] Processing CreateTablet for tablet 5e8d40cde69448e4b68954f340023550 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.630635 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d40cde69448e4b68954f340023550. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.629374 13937 tablet_service.cc:1500] Processing CreateTablet for tablet 7cc15882957b4b0e8cce33725af756c9 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.631963 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc15882957b4b0e8cce33725af756c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.637603 13936 tablet_service.cc:1500] Processing CreateTablet for tablet 29835c96f20f4c939ceb0a7178e3cf6d (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.639449 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29835c96f20f4c939ceb0a7178e3cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.664377 14094 tablet_service.cc:1500] Processing CreateTablet for tablet 5e8d40cde69448e4b68954f340023550 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.670166 14150 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: Bootstrap starting.
I20261115 14:57:50.669632 14015 tablet_service.cc:1500] Processing CreateTablet for tablet 7cc15882957b4b0e8cce33725af756c9 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.669691 14016 tablet_service.cc:1500] Processing CreateTablet for tablet 5e8d40cde69448e4b68954f340023550 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.672479 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d40cde69448e4b68954f340023550. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.672564 14093 tablet_service.cc:1500] Processing CreateTablet for tablet 7cc15882957b4b0e8cce33725af756c9 (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.674285 14014 tablet_service.cc:1500] Processing CreateTablet for tablet 29835c96f20f4c939ceb0a7178e3cf6d (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.673949 14092 tablet_service.cc:1500] Processing CreateTablet for tablet 29835c96f20f4c939ceb0a7178e3cf6d (DEFAULT_TABLE table=test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20261115 14:57:50.676018 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc15882957b4b0e8cce33725af756c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.676983 14015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc15882957b4b0e8cce33725af756c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.677968 14014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29835c96f20f4c939ceb0a7178e3cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.680709 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8d40cde69448e4b68954f340023550. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.681149 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29835c96f20f4c939ceb0a7178e3cf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:57:50.697927 14150 tablet_bootstrap.cc:654] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.713702 14153 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: Bootstrap starting.
I20261115 14:57:50.715392 14152 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: Bootstrap starting.
I20261115 14:57:50.721155 14153 tablet_bootstrap.cc:654] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.723654 14150 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: No bootstrap required, opened a new log
I20261115 14:57:50.724223 14150 ts_tablet_manager.cc:1449] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.013s
I20261115 14:57:50.727432 14150 raft_consensus.cc:360] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.728250 14150 raft_consensus.cc:386] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.728523 14152 tablet_bootstrap.cc:654] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.728585 14150 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.736182 14150 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.741390 14150 ts_tablet_manager.cc:1480] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20261115 14:57:50.766108 14150 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: Bootstrap starting.
I20261115 14:57:50.778716 14150 tablet_bootstrap.cc:654] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.779088 14153 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: No bootstrap required, opened a new log
I20261115 14:57:50.779023 14156 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:50.779662 14153 ts_tablet_manager.cc:1449] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.027s
I20261115 14:57:50.780120 14152 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: No bootstrap required, opened a new log
I20261115 14:57:50.779654 14156 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.780598 14152 ts_tablet_manager.cc:1449] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.030s
I20261115 14:57:50.783159 14153 raft_consensus.cc:360] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.783936 14153 raft_consensus.cc:386] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.783795 14152 raft_consensus.cc:360] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.784281 14153 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.784595 14152 raft_consensus.cc:386] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.784901 14152 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.785176 14153 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.785800 14152 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.792047 14156 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.795258 14152 ts_tablet_manager.cc:1480] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20261115 14:57:50.809676 14152 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: Bootstrap starting.
I20261115 14:57:50.812443 14153 ts_tablet_manager.cc:1480] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: Time spent starting tablet: real 0.032s	user 0.015s	sys 0.017s
I20261115 14:57:50.816833 14152 tablet_bootstrap.cc:654] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.820835 14153 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: Bootstrap starting.
I20261115 14:57:50.829071 14152 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: No bootstrap required, opened a new log
I20261115 14:57:50.829607 14152 ts_tablet_manager.cc:1449] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20261115 14:57:50.829936 14153 tablet_bootstrap.cc:654] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.832695 14152 raft_consensus.cc:360] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.833563 14152 raft_consensus.cc:386] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.833918 14152 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.835150 14152 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.836699 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
W20261115 14:57:50.838646 13913 leader_election.cc:343] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.843129 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:50.843883 14026 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 0.
I20261115 14:57:50.845436 14150 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: No bootstrap required, opened a new log
I20261115 14:57:50.845983 14150 ts_tablet_manager.cc:1449] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.018s
I20261115 14:57:50.846145 14152 ts_tablet_manager.cc:1480] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20261115 14:57:50.849105 14150 raft_consensus.cc:360] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.849826 14150 raft_consensus.cc:386] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.850119 14150 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.851421 14150 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.853627 14150 ts_tablet_manager.cc:1480] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20261115 14:57:50.853734 14152 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: Bootstrap starting.
I20261115 14:57:50.854691 14150 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: Bootstrap starting.
I20261115 14:57:50.846057 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:50.861493 14156 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:50.861893 14156 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:50.862222 14156 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:50.865010 14163 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:50.865603 14163 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.868434 14163 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.874050 14156 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.875624 14156 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.876580 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:50.877065 14026 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:50.880383 14150 tablet_bootstrap.cc:654] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.882737 14026 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 1.
I20261115 14:57:50.884012 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:50.884348 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:50.885063 14156 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:50.885773 14160 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20261115 14:57:50.885864 13913 leader_election.cc:343] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.886351 14160 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.887435 14152 tablet_bootstrap.cc:654] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:50.888716 14156 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:50.889791 14156 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.895043 14160 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.899796 14165 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:50.904672 14165 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.910403 14165 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.899902 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:50.910913 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:50.911873 13948 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 0.
I20261115 14:57:50.911988 14104 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 0.
I20261115 14:57:50.916939 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:50.917586 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:50.919349 14165 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:50.919757 14165 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:50.920172 14153 tablet_bootstrap.cc:492] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: No bootstrap required, opened a new log
W20261115 14:57:50.921067 14067 leader_election.cc:343] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.921116 14153 ts_tablet_manager.cc:1449] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.014s
I20261115 14:57:50.920171 14165 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:50.929467 14070 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:50.930615 14163 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:50.931016 14163 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:50.930860 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:50.931808 14163 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Advancing to term 1
W20261115 14:57:50.938604 13911 leader_election.cc:343] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.943940 14153 raft_consensus.cc:360] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.953490 14153 raft_consensus.cc:386] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.948871 14163 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.959328 14153 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Initialized, Role: FOLLOWER
I20261115 14:57:50.966044 14165 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.972991 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:50.972174 14163 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:50.973778 14165 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:50.974776 13948 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 1: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:50.971328 13679 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 1 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:50.977370 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:50.980700 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:50.984609 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:50.986665 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
W20261115 14:57:50.987378 13911 leader_election.cc:343] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.983850 14153 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:50.989339 14104 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 25a1f4bd36e14df983b98a471f53f937 in current term 1: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
W20261115 14:57:50.991343 14067 leader_election.cc:343] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:50.993705 14153 ts_tablet_manager.cc:1480] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20261115 14:57:50.993770 14152 tablet_bootstrap.cc:492] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: No bootstrap required, opened a new log
I20261115 14:57:50.994443 14152 ts_tablet_manager.cc:1449] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.030s
I20261115 14:57:50.995545 14153 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: Bootstrap starting.
I20261115 14:57:50.997884 14152 raft_consensus.cc:360] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:50.998572 14152 raft_consensus.cc:386] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:50.998872 14152 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Initialized, Role: FOLLOWER
W20261115 14:57:51.002385 13992 leader_election.cc:343] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:51.002562 14070 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:51.003856 14163 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20261115 14:57:51.005872 14152 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.009259 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:51.017899 14152 ts_tablet_manager.cc:1480] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20261115 14:57:51.012401 14165 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20261115 14:57:51.024868 14150 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: No bootstrap required, opened a new log
I20261115 14:57:51.025581 14150 ts_tablet_manager.cc:1449] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.012s
I20261115 14:57:51.026445 14153 tablet_bootstrap.cc:654] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: Neither blocks nor log segments found. Creating new log.
I20261115 14:57:51.029839 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:51.028296 14165 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20261115 14:57:51.052575 13991 leader_election.cc:343] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363): Illegal state: must be running to vote when last-logged opid is not known
I20261115 14:57:51.063493 13900 catalog_manager.cc:1625] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: acquiring CA information for follower catalog manager: success
I20261115 14:57:51.062048 13991 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:51.064818 13901 catalog_manager.cc:1625] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: acquiring CA information for follower catalog manager: success
I20261115 14:57:51.065757 14160 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261115 14:57:51.069958 13901 catalog_manager.cc:1653] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261115 14:57:51.071946 14104 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:51.072674 14150 raft_consensus.cc:360] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.074033 14150 raft_consensus.cc:386] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:51.074348 14150 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Initialized, Role: FOLLOWER
I20261115 14:57:51.075103 14150 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.077281 14150 ts_tablet_manager.cc:1480] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20261115 14:57:51.079867 13900 catalog_manager.cc:1653] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261115 14:57:51.091087 14153 tablet_bootstrap.cc:492] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: No bootstrap required, opened a new log
I20261115 14:57:51.092015 14153 ts_tablet_manager.cc:1449] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.007s
I20261115 14:57:51.093896 14163 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:51.094400 14163 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:51.094813 14153 raft_consensus.cc:360] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.095615 14153 raft_consensus.cc:386] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:57:51.095943 14153 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Initialized, Role: FOLLOWER
I20261115 14:57:51.096807 14153 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.097816 14160 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:51.098295 14160 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.099613 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:51.104519 14174 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:51.105036 14174 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.106340 14163 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:51.107127 14174 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.108601 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:51.109397 13947 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 1: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:51.109653 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:51.110466 14103 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 1: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
I20261115 14:57:51.110392 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:51.111203 14104 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 0.
I20261115 14:57:51.112221 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:51.112490 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:51.112659 14174 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:51.113044 14026 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 0.
I20261115 14:57:51.113255 14160 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.113724 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:51.114517 14163 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261115 14:57:51.114528 13913 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:51.115715 14174 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:57:51.116101 14174 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:51.116448 14174 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:51.122905 13992 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:51.124140 14160 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:51.126783 14174 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.127863 14153 ts_tablet_manager.cc:1480] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20261115 14:57:51.130625 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:51.131273 14026 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:51.137144 14160 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261115 14:57:51.138382 14026 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 1.
I20261115 14:57:51.139982 13911 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:51.141338 14173 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:57:51.141996 14173 raft_consensus.cc:705] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:51.143075 14173 consensus_queue.cc:238] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.153240 14174 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 1 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.155417 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:51.156111 14103 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:57:51.166460 13676 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 1 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:51.175478 14103 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 1.
I20261115 14:57:51.176156 14172 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:57:51.181262 14172 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:51.230582 14165 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:51.231108 14165 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.233593 14165 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.238981 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:51.239634 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:51.239814 14103 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 1.
I20261115 14:57:51.240327 14025 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 1.
I20261115 14:57:51.241328 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:51.242228 14174 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261115 14:57:51.242616 14174 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:51.243018 14174 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:51.248149 14174 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.249589 14174 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 2 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.250588 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:51.250643 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:51.251137 14025 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:51.251287 14103 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:51.255722 14025 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 2.
I20261115 14:57:51.255728 14103 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 2.
I20261115 14:57:51.256906 13911 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:51.257577 14174 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:57:51.257925 14174 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:51.258651 14174 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.265149 14103 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20261115 14:57:51.267005 14025 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20261115 14:57:51.267679 13676 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 0 to 2, leader changed from <none> to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 2 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:51.268962 14174 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:51.269693 14165 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:57:51.616943 13947 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d"
dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
 from {username='slave'} at 127.0.0.1:33814
I20261115 14:57:51.617597 13947 raft_consensus.cc:597] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 LEADER]: Received request to step down
I20261115 14:57:51.617872 13947 raft_consensus.cc:3091] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 LEADER]: Stepping down as leader of term 2
I20261115 14:57:51.618116 13947 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:51.618738 13947 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.619807 13947 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:51.758253 14163 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:51.758896 14163 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.761068 14163 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:51.761770 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:51.762135 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:51.762428 13947 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 3.
I20261115 14:57:51.763520 14070 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:51.764362 14163 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261115 14:57:51.764765 14163 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:51.765098 14163 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:51.770069 14163 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.771528 14163 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:51.772410 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:51.772753 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:51.777634 13947 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 3.
I20261115 14:57:51.778478 14070 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:51.779111 14163 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader election won for term 3
I20261115 14:57:51.780174 14163 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:51.781041 14163 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.798272 13947 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20261115 14:57:51.801963 14160 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:51.802551 14160 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.802186 13677 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 2 to 3, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 70a8e5bf3f114973a6c79283747a896e (127.12.1.3). New cstate: current_term: 3 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } }
I20261115 14:57:51.802855 14205 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:51.804632 14160 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:51.806663 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:51.808243 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:51.809705 14026 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:51.816944 14026 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20261115 14:57:51.818588 13992 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:51.820199 14160 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261115 14:57:51.821619 14163 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20261115 14:57:51.842834 13948 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9"
dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
 from {username='slave'} at 127.0.0.1:33814
I20261115 14:57:51.843478 13948 raft_consensus.cc:597] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Received request to step down
I20261115 14:57:51.843837 13948 raft_consensus.cc:3091] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:51.844154 13948 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:51.851116 13948 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:51.852370 13948 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.000500 14160 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.001078 14160 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.002805 14160 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.003779 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:52.003949 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:52.004458 13948 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 2.
I20261115 14:57:52.005743 13992 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:52.006525 14160 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261115 14:57:52.006893 14160 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.007193 14160 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.012001 14160 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.013836 14160 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.014685 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:52.014950 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:52.019695 13948 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 2.
I20261115 14:57:52.020658 13992 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:52.021411 14160 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:57:52.022610 14160 raft_consensus.cc:705] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 LEADER]: Becoming Leader. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Running, Role: LEADER
I20261115 14:57:52.023813 14160 consensus_queue.cc:238] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.028260 14103 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.029018 13948 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20261115 14:57:52.030707 14160 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:52.032553 13677 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 reported cstate change: term changed from 1 to 2, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2). New cstate: current_term: 2 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:52.055617 14103 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20261115 14:57:52.058535 14210 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:52.059049 14210 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.060920 13947 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "5e8d40cde69448e4b68954f340023550"
dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
 from {username='slave'} at 127.0.0.1:33814
I20261115 14:57:52.061455 13947 raft_consensus.cc:597] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Received request to step down
I20261115 14:57:52.061513 14210 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:52.061700 13947 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:52.062088 13947 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:52.062748 13947 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.063674 13947 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.070637 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:52.070745 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:52.075353 14215 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:52.074364 14070 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:52.083113 14163 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261115 14:57:52.872550 14216 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:52.873140 14216 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.875427 14216 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.875916 14216 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.876427 14216 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.878167 14216 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.891006 14219 raft_consensus.cc:499] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:57:52.891623 14219 raft_consensus.cc:521] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:52.894428 14219 leader_election.cc:290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723)
I20261115 14:57:52.897970 13753 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:57:52.898546 14220 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:52.898687 13753 raft_consensus.cc:2490] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a149406f4749cca582af0b8b0147f5 in term 1.
I20261115 14:57:52.898970 14220 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:52.900307 13793 leader_election.cc:304] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb; no voters: 
I20261115 14:57:52.901391 14220 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.901492 14219 raft_consensus.cc:2826] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261115 14:57:52.901940 14219 raft_consensus.cc:499] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:57:52.902300 14219 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.908989 14219 raft_consensus.cc:521] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:52.910112 13818 raft_consensus.cc:1250] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Rejecting Update request from peer 20af9b506c3c4202822898b70849d240 for earlier term 1. Current term is 2. Ops: []
I20261115 14:57:52.913226 14219 leader_election.cc:290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 2 election: Requested vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723)
I20261115 14:57:52.913727 13753 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb"
I20261115 14:57:52.914355 13753 raft_consensus.cc:3096] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.915381 14222 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.915904 14222 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.918075 14222 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:52.919518 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:52.920225 14026 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 1.
I20261115 14:57:52.921545 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:52.922418 14222 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261115 14:57:52.922845 14222 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.923363 14222 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.924651 13753 raft_consensus.cc:2490] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a149406f4749cca582af0b8b0147f5 in term 2.
I20261115 14:57:52.925990 13793 leader_election.cc:304] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb; no voters: 
I20261115 14:57:52.927982 13688 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240"
I20261115 14:57:52.930135 14220 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:52.930648 14220 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.932763 14222 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.933255 14220 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:52.934738 14222 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:52.934677 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:52.935523 13946 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 2.
I20261115 14:57:52.937290 13992 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:52.937819 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:52.938369 14218 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261115 14:57:52.938736 14218 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:52.939112 14218 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.940436 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:52.937217 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:52.940964 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:52.941684 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:52.942423 14104 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 2: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
I20261115 14:57:52.945149 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:57:52.937465 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:52.947530 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:52.948212 14026 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 3.
I20261115 14:57:52.948369 13946 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 2.
I20261115 14:57:52.952345 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:52.953035 13992 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:52.953285 14222 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:57:52.954133 14216 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:57:52.954296 13851 consensus_queue.cc:1060] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 }, Status: INVALID_TERM, Last received: 1.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20261115 14:57:52.955157 13851 raft_consensus.cc:3091] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 LEADER]: Stepping down as leader of term 1
I20261115 14:57:52.955477 13851 raft_consensus.cc:748] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20af9b506c3c4202822898b70849d240, State: Running, Role: LEADER
I20261115 14:57:52.956174 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:52.956519 13851 consensus_queue.cc:261] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:52.957855 13851 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:57:52.959327 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:52.960134 13911 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:52.961436 14220 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261115 14:57:52.961809 14220 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:52.962230 14220 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:52.963404 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:52.964555 14219 raft_consensus.cc:2826] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:57:52.955466 14218 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.966260 14024 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 2.
I20261115 14:57:52.967439 14218 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:52.953913 14222 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:52.969339 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:52.970018 14219 raft_consensus.cc:705] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 LEADER]: Becoming Leader. State: Replica: c6a149406f4749cca582af0b8b0147f5, State: Running, Role: LEADER
I20261115 14:57:52.970304 14222 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:52.970920 14219 consensus_queue.cc:238] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:52.969285 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:53.002708 14220 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.016942 13946 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20261115 14:57:53.018280 14224 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6a149406f4749cca582af0b8b0147f5. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.019440 14224 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:53.030330 14220 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.031181 14220 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261115 14:57:53.031646 14220 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:53.032662 14220 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.034765 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:53.035998 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.038645 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:53.048844 14228 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20261115 14:57:53.077368 14024 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20261115 14:57:53.081212 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:53.082849 14220 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.089428 13946 raft_consensus.cc:2390] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 for earlier term 2. Current term is 3.
I20261115 14:57:53.093626 14229 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20261115 14:57:53.095160 14226 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20261115 14:57:53.103600 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.106585 13992 leader_election.cc:400] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 election: Vote denied by peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611) with higher term. Message: Invalid argument: T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 for earlier term 2. Current term is 3.
I20261115 14:57:53.104990 13948 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20261115 14:57:53.107399 13992 leader_election.cc:403] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20261115 14:57:53.110013 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:53.109879 14227 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20261115 14:57:53.110947 14229 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 LEADER]: Stepping down as leader of term 2
I20261115 14:57:53.099365 14220 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.111336 14229 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:53.112601 13753 raft_consensus.cc:1285] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Refusing update from remote peer c6a149406f4749cca582af0b8b0147f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20261115 14:57:53.112538 14229 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.113755 14229 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.114648 14233 consensus_queue.cc:1049] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20261115 14:57:53.115530 13689 raft_consensus.cc:1285] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Refusing update from remote peer c6a149406f4749cca582af0b8b0147f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20261115 14:57:53.118718 14216 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.120510 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:53.123184 14220 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20261115 14:57:53.124030 13851 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:53.124513 13851 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:53.126186 13851 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:53.126904 13754 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:57:53.126859 14216 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611) with higher term. Message: Invalid argument: T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 for earlier term 2. Current term is 3.
I20261115 14:57:53.129069 13818 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:57:53.130524 13663 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20af9b506c3c4202822898b70849d240; no voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:53.131731 13851 raft_consensus.cc:2771] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261115 14:57:53.133822 14235 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6a149406f4749cca582af0b8b0147f5. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.134599 14235 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:53.118257 14224 consensus_queue.cc:1049] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20261115 14:57:53.142791 14235 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.143602 14235 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:53.146222 14219 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.147222 14219 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:53.148221 14231 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:57:53.149626 14221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.150369 14221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:53.150064 13851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6a149406f4749cca582af0b8b0147f5. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.150796 13851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:53.153337 13948 raft_consensus.cc:1250] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 3. Current term is 4. Ops: []
I20261115 14:57:53.154798 14229 consensus_queue.cc:1060] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:57:53.155092 14231 catalog_manager.cc:694] Loaded metadata for table test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]
I20261115 14:57:53.155627 14227 raft_consensus.cc:3091] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 LEADER]: Stepping down as leader of term 3
I20261115 14:57:53.155961 14227 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:53.156769 14227 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.158041 14227 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:53.162261 14231 tablet_loader.cc:96] loaded metadata for tablet 29835c96f20f4c939ceb0a7178e3cf6d (table test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:53.164283 14231 tablet_loader.cc:96] loaded metadata for tablet 5e8d40cde69448e4b68954f340023550 (table test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:53.165802 14231 tablet_loader.cc:96] loaded metadata for tablet 7cc15882957b4b0e8cce33725af756c9 (table test-table [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:53.166712 14231 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:53.169752 14231 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:53.169998 14231 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:53.173687 14231 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:53.176673 14231 catalog_manager.cc:6232] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Loaded TSK: 0
I20261115 14:57:53.177534 14231 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:53.205855 14216 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:53.206496 14216 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.208948 14216 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.209252 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:53.210062 13948 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 4: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.210234 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:53.210875 14103 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 4.
I20261115 14:57:53.211890 13991 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:57:53.212538 14216 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261115 14:57:53.212829 14216 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:53.213083 14216 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:53.218223 14216 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.219923 14216 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.220731 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:53.221257 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:53.221474 13948 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 4: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.226965 14103 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 4.
I20261115 14:57:53.227890 13991 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:57:53.228593 14216 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Leader election won for term 4
I20261115 14:57:53.229063 14216 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Becoming Leader. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Running, Role: LEADER
I20261115 14:57:53.229880 14216 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.235255 14103 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20261115 14:57:53.235711 13948 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20261115 14:57:53.237793 14217 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20261115 14:57:53.239462 14219 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c6a149406f4749cca582af0b8b0147f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:53.240330 14219 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:53.242976 13973 heartbeater.cc:500] Master 127.12.1.60:43497 was elected leader, sending a full tablet report...
I20261115 14:57:53.242892 13807 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 reported cstate change: term changed from 3 to 4, leader changed from 70a8e5bf3f114973a6c79283747a896e (127.12.1.3) to 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2). New cstate: current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:53.267813 14218 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:57:53.270809 14051 heartbeater.cc:500] Master 127.12.1.60:43497 was elected leader, sending a full tablet report...
I20261115 14:57:53.274468 14129 heartbeater.cc:500] Master 127.12.1.60:43497 was elected leader, sending a full tablet report...
I20261115 14:57:53.350731 14227 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:53.351265 14227 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.352866 14227 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.353626 14220 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:53.353794 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:53.354115 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.354123 14220 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.354857 14024 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 3.
I20261115 14:57:53.355176 13948 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 3.
I20261115 14:57:53.356016 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:53.356343 14220 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.356940 14227 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261115 14:57:53.357287 14227 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:57:53.357564 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.357620 14227 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:53.357621 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:53.358549 14024 raft_consensus.cc:2432] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25a1f4bd36e14df983b98a471f53f937 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20261115 14:57:53.363644 14227 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.364876 14103 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25a1f4bd36e14df983b98a471f53f937 in current term 4: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
I20261115 14:57:53.365777 14227 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.366744 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:53.366977 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.367271 13948 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:53.367579 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:53.367579 14024 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:53.372836 13948 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 4.
I20261115 14:57:53.373337 14220 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:57:53.373934 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:53.374751 14024 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 4.
I20261115 14:57:53.374879 14227 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader election won for term 4
I20261115 14:57:53.375615 14227 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:53.376497 14227 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.386502 13948 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20261115 14:57:53.388114 14227 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:53.387760 13807 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 1 to 4, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 70a8e5bf3f114973a6c79283747a896e (127.12.1.3). New cstate: current_term: 4 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:53.388720 14024 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20261115 14:57:53.390216 14229 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:57:53.450522 14024 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d"
dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
 from {username='slave'} at 127.0.0.1:37798
I20261115 14:57:53.451192 14024 raft_consensus.cc:597] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Received request to step down
I20261115 14:57:53.451560 14024 raft_consensus.cc:3091] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Stepping down as leader of term 4
I20261115 14:57:53.451864 14024 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Running, Role: LEADER
I20261115 14:57:53.452610 14024 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.453958 14024 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:57:53.564636 14220 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.565140 14220 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.566768 14220 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.567633 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.567746 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:53.568264 14024 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 5.
I20261115 14:57:53.569250 13911 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:53.569897 14220 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20261115 14:57:53.570251 14220 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.570488 14220 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:57:53.575023 14220 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.576622 14220 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.577524 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:53.577589 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.582504 14024 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 5.
I20261115 14:57:53.582988 14227 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.583595 13911 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:53.583529 14227 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.584430 14220 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Leader election won for term 5
I20261115 14:57:53.584918 14220 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:53.585688 14227 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.585688 14220 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.587360 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:53.591625 14104 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:57:53.587471 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.594417 14024 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 5: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.595615 14067 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:53.598793 14024 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20261115 14:57:53.600432 14104 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20261115 14:57:53.601167 14227 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:57:53.601018 14253 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20261115 14:57:53.600378 13808 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 4 to 5, leader changed from 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2) to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 5 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:53.604103 14220 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20261115 14:57:53.662040 14024 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9"
dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
 from {username='slave'} at 127.0.0.1:37798
I20261115 14:57:53.663576 14024 raft_consensus.cc:597] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 LEADER]: Received request to step down
I20261115 14:57:53.665413 14024 raft_consensus.cc:3091] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 LEADER]: Stepping down as leader of term 2
I20261115 14:57:53.665745 14024 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Running, Role: LEADER
I20261115 14:57:53.666541 14024 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.667785 14024 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.783062 14226 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.783717 14226 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.786500 14226 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.786803 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.787473 14026 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 3.
I20261115 14:57:53.787400 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:53.788748 13911 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:53.790825 14226 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261115 14:57:53.791220 14226 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.791604 14226 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.792894 14227 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.793377 14227 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.795380 14227 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.796139 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:53.796442 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:53.797087 14024 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 3.
I20261115 14:57:53.798127 14067 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:53.798029 14226 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.798956 14227 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261115 14:57:53.799264 13948 raft_consensus.cc:2415] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 3: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.799389 14227 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:57:53.799801 14227 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:53.800530 14226 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:53.801227 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:53.801332 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.805610 14227 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.806362 14024 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 3.
I20261115 14:57:53.806623 14104 raft_consensus.cc:2415] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25a1f4bd36e14df983b98a471f53f937 in current term 3: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
I20261115 14:57:53.807528 13911 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:57:53.807842 14227 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:53.808621 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:53.809319 13948 raft_consensus.cc:2415] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 3: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.809674 14254 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Leader election won for term 3
I20261115 14:57:53.809862 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:53.810721 14024 raft_consensus.cc:2415] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 3: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:57:53.810912 14254 raft_consensus.cc:705] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:53.811793 14254 consensus_queue.cc:238] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:53.812232 14067 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:53.812958 14227 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20261115 14:57:53.817135 14104 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20261115 14:57:53.817821 14024 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20261115 14:57:53.819768 14226 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:57:53.821080 14254 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:57:53.821524 13808 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 2 to 3, leader changed from 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2) to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 3 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:53.891487 14104 tablet_service.cc:2061] Received LeaderStepDown RPC: tablet_id: "5e8d40cde69448e4b68954f340023550"
dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
 from {username='slave'} at 127.0.0.1:51612
I20261115 14:57:53.892025 14104 raft_consensus.cc:597] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 LEADER]: Received request to step down
I20261115 14:57:53.892395 14104 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 LEADER]: Stepping down as leader of term 4
I20261115 14:57:53.892637 14104 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:53.893404 14104 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:53.894519 14104 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Advancing to term 5
W20261115 14:57:53.928700 14125 debug-util.cc:398] Leaking SignalData structure 0x7b0800213060 after lost signal to thread 12295
W20261115 14:57:53.929598 14125 debug-util.cc:398] Leaking SignalData structure 0x7b08002137c0 after lost signal to thread 13713
W20261115 14:57:53.930426 14125 debug-util.cc:398] Leaking SignalData structure 0x7b0800213e80 after lost signal to thread 13778
W20261115 14:57:53.931172 14125 debug-util.cc:398] Leaking SignalData structure 0x7b0800251fa0 after lost signal to thread 13843
W20261115 14:57:53.932372 14125 debug-util.cc:398] Leaking SignalData structure 0x7b080024ef40 after lost signal to thread 13972
I20261115 14:57:53.971283 13891 catalog_manager.cc:1653] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261115 14:57:54.046716 14253 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:54.047256 14253 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:54.049072 14253 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:54.049997 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:54.050597 14103 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 5.
I20261115 14:57:54.050401 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:54.051816 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:57:54.052853 14253 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20261115 14:57:54.053200 14253 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:57:54.053552 14253 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:57:54.059849 14253 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:54.061828 14253 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:54.063288 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:57:54.063452 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:54.068781 14103 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 5.
I20261115 14:57:54.069775 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:54.070448 14254 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Leader election won for term 5
I20261115 14:57:54.070940 14254 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:54.071558 14254 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:54.076472 14103 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20261115 14:57:54.078085 14024 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:57:54.078580 14253 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20261115 14:57:54.110674 14024 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20261115 14:57:54.113098 14218 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:57:54.113556 14218 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:54.113926 13807 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 4 to 5, leader changed from 70a8e5bf3f114973a6c79283747a896e (127.12.1.3) to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 5 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } }
I20261115 14:57:54.116415 14218 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:54.118081 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:54.138589 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:54.141564 14253 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20261115 14:57:54.143957 13992 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:54.153075 14218 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20261115 14:57:54.181541 13807 catalog_manager.cc:3585] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44488:
table { table_id: "a0aaccfd41d84d2e9a85e37d6bbc6eed" table_name: "test-table" } new_table_name: "NewTableName"
I20261115 14:57:54.214814 12292 master.cc:585] Master@127.12.1.60:43497 shutting down...
I20261115 14:57:54.271314 14266 tablet.cc:1759] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.303472 14274 tablet.cc:1759] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.317150 14270 tablet.cc:1759] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.319945 14275 tablet.cc:1759] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.318905 14271 tablet.cc:1759] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.338785 14272 tablet.cc:1759] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.340998 14269 tablet.cc:1759] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.341053 14266 tablet.cc:1759] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.402974 14276 tablet.cc:1759] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261115 14:57:54.424961 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 LEADER]: Raft consensus shutting down.
I20261115 14:57:54.425997 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:54.426455 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: stopping tablet replica
I20261115 14:57:54.471459 12292 master.cc:607] Master@127.12.1.60:43497 shutdown complete.
I20261115 14:57:54.576522 14280 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a149406f4749cca582af0b8b0147f5)
I20261115 14:57:54.577020 14280 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:54.578914 14280 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:54.579658 13753 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 3 candidate_status { last_received { term: 2 index: 18 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
W20261115 14:57:54.582201 13663 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20261115 14:57:54.586052 13663 leader_election.cc:336] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497): Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
I20261115 14:57:54.586504 13663 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20af9b506c3c4202822898b70849d240; no voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:54.587218 14280 raft_consensus.cc:2771] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261115 14:57:54.602167 14283 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a149406f4749cca582af0b8b0147f5)
I20261115 14:57:54.603957 14283 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:54.605839 14283 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:54.606664 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 18 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:57:54.607401 13689 raft_consensus.cc:2490] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7b468eb37d4054b52193916a9a47eb in term 2.
I20261115 14:57:54.608726 13730 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb; no voters: 
I20261115 14:57:54.609622 14283 raft_consensus.cc:2826] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261115 14:57:54.610004 14283 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6a149406f4749cca582af0b8b0147f5)
I20261115 14:57:54.610388 14283 raft_consensus.cc:3096] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 2 FOLLOWER]: Advancing to term 3
W20261115 14:57:54.612147 13728 leader_election.cc:336] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497): Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
I20261115 14:57:54.617954 14283 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:54.620231 14283 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 election: Requested vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:54.621196 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 18 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240"
I20261115 14:57:54.621799 13689 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 2 FOLLOWER]: Advancing to term 3
W20261115 14:57:54.624570 13728 leader_election.cc:336] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497): Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111)
I20261115 14:57:54.629952 13689 raft_consensus.cc:2490] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7b468eb37d4054b52193916a9a47eb in term 3.
I20261115 14:57:54.631265 13730 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb; no voters: c6a149406f4749cca582af0b8b0147f5
I20261115 14:57:54.632161 14283 raft_consensus.cc:2826] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Leader election won for term 3
I20261115 14:57:54.633217 14283 raft_consensus.cc:705] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 LEADER]: Becoming Leader. State: Replica: eb7b468eb37d4054b52193916a9a47eb, State: Running, Role: LEADER
I20261115 14:57:54.634102 14283 consensus_queue.cc:238] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:54.639113 14286 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:54.640059 14286 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:54.641912 13689 raft_consensus.cc:1285] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Refusing update from remote peer eb7b468eb37d4054b52193916a9a47eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 18. Preceding OpId from leader: term: 3 index: 19. (index mismatch)
I20261115 14:57:54.645927 14287 consensus_queue.cc:1049] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20261115 14:57:54.647513 13728 consensus_peers.cc:597] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb -> Peer c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497): Couldn't send request to peer c6a149406f4749cca582af0b8b0147f5. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.60:43497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261115 14:57:54.653304 14280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:54.654188 14280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:54.655968 14280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:54.656788 14280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:54.678738 14291 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:54.679601 14291 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:54.688122 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261115 14:57:54.696189 14290 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
W20261115 14:57:54.705350 14293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:54.706691 14290 catalog_manager.cc:694] Loaded metadata for table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]
W20261115 14:57:54.708474 14292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:54.724187 14290 tablet_loader.cc:96] loaded metadata for tablet 29835c96f20f4c939ceb0a7178e3cf6d (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
W20261115 14:57:54.724722 14295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:54.724191 12292 server_base.cc:1061] running on GCE node
I20261115 14:57:54.725904 14290 tablet_loader.cc:96] loaded metadata for tablet 5e8d40cde69448e4b68954f340023550 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:54.726653 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:54.727036 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:54.727340 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754674727322 us; error 0 us; skew 500 ppm
I20261115 14:57:54.727537 14290 tablet_loader.cc:96] loaded metadata for tablet 7cc15882957b4b0e8cce33725af756c9 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:54.728368 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:54.729151 14290 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:54.732144 12292 webserver.cc:577] Webserver started at http://127.12.1.60:34265/ using document root <none> and password file <none>
I20261115 14:57:54.732838 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:54.733068 12292 fs_manager.cc:365] Using existing metadata directory in first data directory
I20261115 14:57:54.733624 14290 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:54.733930 14290 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:54.738343 14290 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:57:54.738365 12292 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20261115 14:57:54.743248 14290 catalog_manager.cc:6232] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Loaded TSK: 0
I20261115 14:57:54.744378 14290 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:57:54.751756 14300 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:54.753237 12292 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.007s	sys 0.002s
I20261115 14:57:54.753734 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
uuid: "c6a149406f4749cca582af0b8b0147f5"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:54.754170 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:54.786830 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:54.788278 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:54.849061 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.60:43497
I20261115 14:57:54.849157 14351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.60:43497 every 8 connection(s)
I20261115 14:57:54.888787 14130 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:57:54.893823 14052 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:57:54.900902 14352 sys_catalog.cc:263] Verifying existing consensus state
I20261115 14:57:54.917768 14352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Bootstrap starting.
I20261115 14:57:54.954753 13974 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:57:54.974622 13973 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:54.997713 14129 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:55.000824 14051 heartbeater.cc:345] Connected to a master server at 127.12.1.60:43497
I20261115 14:57:55.014020 13743 catalog_manager.cc:6393] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed] alter complete (version 1)
I20261115 14:57:55.081298 14352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=7 ignored=0} mutations{seen=14 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:57:55.082334 14352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: Bootstrap complete.
I20261115 14:57:55.085248 14352 raft_consensus.cc:360] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.086020 14352 raft_consensus.cc:748] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a149406f4749cca582af0b8b0147f5, State: Initialized, Role: FOLLOWER
I20261115 14:57:55.086859 14352 consensus_queue.cc:261] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.089440 14361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.090301 14361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.090536 14352 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:55.090978 14327 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 2 FOLLOWER]: Advancing to term 3
I20261115 14:57:55.132860 14369 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.133291 14361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.133737 14369 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.133986 14361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.137388 14288 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.138365 14288 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:55.155015 14376 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:55.155369 14376 catalog_manager.cc:1603] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: loading cluster ID for follower catalog manager: success
I20261115 14:57:55.163700 14376 catalog_manager.cc:1625] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: acquiring CA information for follower catalog manager: success
I20261115 14:57:55.167528 14376 catalog_manager.cc:1653] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261115 14:57:55.214440 14317 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" instance_seqno: 1794754670132099) as {username='slave'} at 127.0.0.1:44650; Asking this server to re-register.
I20261115 14:57:55.216179 13973 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.219725 14317 ts_manager.cc:210] Registered new tserver with Master: 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611)
I20261115 14:57:55.220315 14316 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" instance_seqno: 1794754670459313) as {username='slave'} at 127.0.0.1:44654; Asking this server to re-register.
I20261115 14:57:55.222077 14129 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.227142 14316 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" instance_seqno: 1794754670287282) as {username='slave'} at 127.0.0.1:44670; Asking this server to re-register.
I20261115 14:57:55.228155 14317 ts_manager.cc:210] Registered new tserver with Master: 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:55.229445 14051 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.236759 14316 ts_manager.cc:210] Registered new tserver with Master: 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:55.236881 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.337789961s
I20261115 14:57:55.251566 12292 master.cc:585] Master@127.12.1.61:44723 shutting down...
I20261115 14:57:55.299238 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 LEADER]: Raft consensus shutting down.
I20261115 14:57:55.300262 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20261115 14:57:55.300787 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: stopping tablet replica
I20261115 14:57:55.314775 12292 master.cc:607] Master@127.12.1.61:44723 shutdown complete.
I20261115 14:57:55.414469 14377 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb7b468eb37d4054b52193916a9a47eb)
I20261115 14:57:55.414975 14377 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.416744 14377 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:55.424711 14361 raft_consensus.cc:499] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb7b468eb37d4054b52193916a9a47eb)
I20261115 14:57:55.425328 14361 raft_consensus.cc:521] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.433360 14361 leader_election.cc:290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723)
W20261115 14:57:55.434051 13664 leader_election.cc:336] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723): Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
I20261115 14:57:55.436880 14327 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:57:55.437635 14327 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 3.
I20261115 14:57:55.439034 13663 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20af9b506c3c4202822898b70849d240, c6a149406f4749cca582af0b8b0147f5; no voters: eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:55.440296 14377 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261115 14:57:55.440722 14377 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb7b468eb37d4054b52193916a9a47eb)
I20261115 14:57:55.441100 14377 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:55.449949 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:57:55.453182 14377 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.455341 14377 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 election: Requested vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:55.455533 13689 raft_consensus.cc:2415] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a149406f4749cca582af0b8b0147f5 in current term 4: Already voted for candidate 20af9b506c3c4202822898b70849d240 in this term.
W20261115 14:57:55.456188 14302 leader_election.cc:336] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723): Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
I20261115 14:57:55.459302 14303 leader_election.cc:304] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5; no voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:55.460502 14361 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:55.460775 14327 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5"
W20261115 14:57:55.460954 13664 leader_election.cc:336] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723): Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111)
I20261115 14:57:55.469341 14361 raft_consensus.cc:2771] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:57:55.477136 14327 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20af9b506c3c4202822898b70849d240 in term 4.
I20261115 14:57:55.479210 13663 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20af9b506c3c4202822898b70849d240, c6a149406f4749cca582af0b8b0147f5; no voters: eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:55.480432 14377 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 FOLLOWER]: Leader election won for term 4
I20261115 14:57:55.481600 14377 raft_consensus.cc:705] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 LEADER]: Becoming Leader. State: Replica: 20af9b506c3c4202822898b70849d240, State: Running, Role: LEADER
I20261115 14:57:55.482573 14377 consensus_queue.cc:238] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 3.20, Last appended by leader: 20, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.487046 14385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.487850 14385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:55.493930 14327 raft_consensus.cc:1285] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Refusing update from remote peer 20af9b506c3c4202822898b70849d240: Log matching property violated. Preceding OpId in replica: term: 3 index: 20. Preceding OpId from leader: term: 4 index: 21. (index mismatch)
I20261115 14:57:55.497305 14386 consensus_queue.cc:1049] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20261115 14:57:55.499431 14387 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
W20261115 14:57:55.504101 13664 consensus_peers.cc:597] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 -> Peer eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723): Couldn't send request to peer eb7b468eb37d4054b52193916a9a47eb. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.61:44723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261115 14:57:55.507050 14361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.507843 14361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.508963 14387 catalog_manager.cc:694] Loaded metadata for table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]
I20261115 14:57:55.515727 14387 tablet_loader.cc:96] loaded metadata for tablet 29835c96f20f4c939ceb0a7178e3cf6d (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:55.515491 14361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.516567 14361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.517284 14387 tablet_loader.cc:96] loaded metadata for tablet 5e8d40cde69448e4b68954f340023550 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:55.518810 14387 tablet_loader.cc:96] loaded metadata for tablet 7cc15882957b4b0e8cce33725af756c9 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:57:55.519963 14389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.520589 14387 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:57:55.520679 14389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:55.525853 14387 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:55.526211 14387 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:57:55.528308 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261115 14:57:55.531909 14387 catalog_manager.cc:1555] Loading token signing keys...
W20261115 14:57:55.535576 14391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:55.537493 14387 catalog_manager.cc:6232] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: Loaded TSK: 0
I20261115 14:57:55.538578 14387 catalog_manager.cc:1565] Initializing in-progress tserver states...
W20261115 14:57:55.542811 14392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:55.550889 12292 server_base.cc:1061] running on GCE node
W20261115 14:57:55.552026 14394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:57:55.553063 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:57:55.553331 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:57:55.553540 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754675553521 us; error 0 us; skew 500 ppm
I20261115 14:57:55.554059 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:57:55.557101 12292 webserver.cc:577] Webserver started at http://127.12.1.61:34691/ using document root <none> and password file <none>
I20261115 14:57:55.557575 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:57:55.557785 12292 fs_manager.cc:365] Using existing metadata directory in first data directory
I20261115 14:57:55.563261 12292 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.002s
I20261115 14:57:55.567193 14399 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:57:55.568166 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20261115 14:57:55.568486 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
uuid: "eb7b468eb37d4054b52193916a9a47eb"
format_stamp: "Formatted at 2026-11-15 14:57:49 on dist-test-slave-fhcn"
I20261115 14:57:55.568770 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:57:55.583976 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:57:55.585194 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:57:55.646063 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.61:44723
I20261115 14:57:55.646159 14450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.61:44723 every 8 connection(s)
I20261115 14:57:55.661312 14451 sys_catalog.cc:263] Verifying existing consensus state
I20261115 14:57:55.663079 14132 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:55.669921 14451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Bootstrap starting.
I20261115 14:57:55.681527 14053 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:55.693528 13975 heartbeater.cc:500] Master 127.12.1.62:35143 was elected leader, sending a full tablet report...
I20261115 14:57:55.704702 14130 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
I20261115 14:57:55.708940 14052 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
I20261115 14:57:55.716527 13974 heartbeater.cc:345] Connected to a master server at 127.12.1.61:44723
I20261115 14:57:55.773761 14451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=7 ignored=0} mutations{seen=15 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:57:55.774807 14451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Bootstrap complete.
I20261115 14:57:55.778059 14451 raft_consensus.cc:360] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.778735 14451 raft_consensus.cc:748] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7b468eb37d4054b52193916a9a47eb, State: Initialized, Role: FOLLOWER
I20261115 14:57:55.779454 14451 consensus_queue.cc:261] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 20, Last appended: 3.20, Last appended by leader: 20, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:55.782588 14457 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.783511 14457 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.785508 14451 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:57:55.786412 14426 raft_consensus.cc:3096] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:57:55.837249 14457 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af9b506c3c4202822898b70849d240. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.838089 14457 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.841288 14465 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.842762 14465 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:57:55.853667 14471 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:57:55.854043 14471 catalog_manager.cc:1603] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: loading cluster ID for follower catalog manager: success
I20261115 14:57:55.859290 14471 catalog_manager.cc:1625] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: acquiring CA information for follower catalog manager: success
I20261115 14:57:55.863971 14471 catalog_manager.cc:1653] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261115 14:57:55.893692 14386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "20af9b506c3c4202822898b70849d240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:57:55.894490 14386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: LEADER
I20261115 14:57:55.930218 14416 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" instance_seqno: 1794754670459313) as {username='slave'} at 127.0.0.1:50594; Asking this server to re-register.
I20261115 14:57:55.930943 14414 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" instance_seqno: 1794754670287282) as {username='slave'} at 127.0.0.1:50602; Asking this server to re-register.
I20261115 14:57:55.932361 14130 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.932704 14052 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.932436 14415 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" instance_seqno: 1794754670132099) as {username='slave'} at 127.0.0.1:50618; Asking this server to re-register.
I20261115 14:57:55.934846 13974 heartbeater.cc:462] Registering TS with master...
I20261115 14:57:55.936705 14415 ts_manager.cc:210] Registered new tserver with Master: 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:55.939180 14414 ts_manager.cc:210] Registered new tserver with Master: 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:55.939548 14415 ts_manager.cc:210] Registered new tserver with Master: 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611)
I20261115 14:57:55.940662 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.286297176s
I20261115 14:57:58.027170 14475 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:57:58.028302 14475 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:58.238107 14475 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:57:58.243847 14477 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:58.244516 14477 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:58.252411 14477 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:58.268144 14477 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:58.268740 14477 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:58.271694 14477 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:57:58.272140 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:58.295428 14478 raft_consensus.cc:499] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:57:58.296099 14478 raft_consensus.cc:521] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:57:58.299603 14478 leader_election.cc:290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723)
I20261115 14:57:58.302496 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
W20261115 14:57:58.651167 13969 debug-util.cc:398] Leaking SignalData structure 0x7b0800049060 after lost signal to thread 12295
W20261115 14:57:58.931761 14403 thread.cc:642] raft [worker] (thread pool) Time spent creating pthread: real 1.917s	user 0.017s	sys 0.015s
W20261115 14:57:58.932366 14403 thread.cc:609] raft [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.017s	sys 0.015s
I20261115 14:57:58.936991 13677 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38888 (request call id 75) took 1979 ms. Trace:
I20261115 14:57:58.937505 13677 rpcz_store.cc:276] 1115 14:57:56.957498 (+     0us) service_pool.cc:167] Inserting onto call queue
1115 14:57:58.935231 (+1977733us) service_pool.cc:224] Handling call
1115 14:57:58.936829 (+  1598us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20261115 14:57:58.942008 14480 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
W20261115 14:57:58.941974 13992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.1.1:35611, user_credentials={real_user=slave}} blocked reactor thread for 443236us
I20261115 14:57:58.942915 14480 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:58.944703 14482 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:58.947745 14482 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:58.945604 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:58.950111 14482 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:58.947062 13945 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:58.951450 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:58.953646 14480 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
W20261115 14:57:58.963636 13948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33786 (request call id 26) took 695 ms (client timeout 231 ms). Trace:
W20261115 14:57:58.964174 13948 rpcz_store.cc:269] 1115 14:57:58.267856 (+     0us) service_pool.cc:167] Inserting onto call queue
1115 14:57:58.963204 (+695348us) service_pool.cc:211] Skipping call since client already timed out
1115 14:57:58.963397 (+   193us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20261115 14:57:58.971926 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:57:58.985294 14326 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:57:58.987334 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:58.987490 14400 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb7b468eb37d4054b52193916a9a47eb; no voters: 20af9b506c3c4202822898b70849d240, c6a149406f4749cca582af0b8b0147f5
I20261115 14:57:58.988185 14026 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 5.
I20261115 14:57:58.990041 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:57:58.991119 14480 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20261115 14:57:58.991593 14480 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:58.992167 14480 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:58.992499 14488 raft_consensus.cc:2771] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:57:58.992899 14482 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:58.993439 14482 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:58.995532 14482 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:58.996359 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:57:58.997221 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:58.997874 14025 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 5.
I20261115 14:57:58.999168 14067 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:57:59.000949 14482 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20261115 14:57:59.001288 14482 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:57:59.001598 14482 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:59.002498 14480 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:59.005863 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:59.009456 14026 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:59.010049 14026 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:59.009321 14482 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:59.013798 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:57:59.014388 14025 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:59.015364 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:57:59.028626 14101 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 5. Current term is 6. Ops: []
I20261115 14:57:59.029470 14104 raft_consensus.cc:1250] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 5. Current term is 6. Ops: []
I20261115 14:57:59.018007 14480 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:59.030684 14268 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20261115 14:57:59.018468 14026 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 6.
I20261115 14:57:59.031929 14226 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Stepping down as leader of term 5
I20261115 14:57:59.032343 14226 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:59.032706 14268 consensus_queue.cc:1060] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20261115 14:57:59.033293 14226 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:59.033813 14022 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 5. Current term is 6. Ops: []
I20261115 14:57:59.034561 14226 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:59.034794 14102 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:59.036921 13991 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:59.037212 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:57:59.038311 14480 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Leader election won for term 6
I20261115 14:57:59.024106 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:57:59.040934 14103 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 6: Already voted for candidate 70a8e5bf3f114973a6c79283747a896e in this term.
I20261115 14:57:59.021885 14025 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 6.
I20261115 14:57:59.043434 14021 raft_consensus.cc:1250] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 5. Current term is 6. Ops: []
I20261115 14:57:59.043457 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:57:59.046768 14067 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
W20261115 14:57:59.048782 13969 debug-util.cc:398] Leaking SignalData structure 0x7b0800151820 after lost signal to thread 13972
W20261115 14:57:59.050279 13969 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3220 after lost signal to thread 14050
W20261115 14:57:59.051687 13969 debug-util.cc:398] Leaking SignalData structure 0x7b08000ee620 after lost signal to thread 14128
I20261115 14:57:59.054054 14067 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:57:59.057531 14494 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Leader election won for term 6
I20261115 14:57:59.018576 14482 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 6 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:57:59.061416 13991 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:57:59.064998 14490 raft_consensus.cc:3091] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Stepping down as leader of term 5
I20261115 14:57:59.065475 14490 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:57:59.067111 14495 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:57:59.065012 14268 consensus_queue.cc:1060] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20261115 14:57:59.070328 14490 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:59.072988 14494 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:59.080312 14497 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20261115 14:57:59.059465 14492 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:57:59.088622 14490 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 5 FOLLOWER]: Advancing to term 6
I20261115 14:57:59.092579 14426 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:57:59.095034 14302 leader_election.cc:304] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5; no voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:57:59.086928 14480 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:57:59.103121 14480 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:57:59.080526 14494 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:57:59.108920 14499 raft_consensus.cc:2771] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:57:59.115170 14025 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20261115 14:57:59.115362 13948 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20261115 14:57:59.116549 14494 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20261115 14:57:59.117446 14482 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20261115 14:57:59.127099 13947 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20261115 14:57:59.128818 14482 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20261115 14:57:59.143118 13677 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 5 to 6, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 70a8e5bf3f114973a6c79283747a896e (127.12.1.3). New cstate: current_term: 6 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:57:59.153061 13678 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 5 to 6, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 70a8e5bf3f114973a6c79283747a896e (127.12.1.3). New cstate: current_term: 6 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } }
I20261115 14:57:59.157588 14021 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20261115 14:57:59.159842 14494 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20261115 14:58:03.942152 14527 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:03.942670 14527 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:03.946417 14527 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:03.968918 14528 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:03.969645 14528 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:03.971932 14528 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:03.985067 14530 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:03.985864 14530 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:03.996791 14530 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:04.021721 14025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:04.022439 14025 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 6.
I20261115 14:58:04.025000 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:58:04.025939 14528 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20261115 14:58:04.026369 14528 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:04.026793 14528 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:04.037774 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:04.036168 14528 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:04.041832 14528 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:04.042860 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:04.050889 14528 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:04.052407 14528 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:04.057796 14528 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:04.058511 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:04.059934 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:04.061010 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:04.061934 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:04.062170 14101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:04.062706 13945 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 6. Current term is 7. Ops: []
I20261115 14:58:04.064924 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:04.066061 14070 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:04.066583 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:04.067147 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:04.067955 13947 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 7: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:58:04.067996 14528 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261115 14:58:04.102669 14529 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20261115 14:58:04.079715 14102 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:04.068351 14532 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261115 14:58:04.109880 13991 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:04.111044 14527 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:04.081700 14537 raft_consensus.cc:499] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:58:04.112884 14537 raft_consensus.cc:521] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:04.111223 14538 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:58:04.075374 14534 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20261115 14:58:04.116568 14534 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Stepping down as leader of term 6
I20261115 14:58:04.116905 14534 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:04.117286 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:58:04.117877 14527 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261115 14:58:04.117697 14534 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:04.119588 14537 leader_election.cc:290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723)
I20261115 14:58:04.120302 14538 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:04.120642 14426 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6a149406f4749cca582af0b8b0147f5" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:58:04.122141 14302 leader_election.cc:304] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5; no voters: 20af9b506c3c4202822898b70849d240, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:58:04.123852 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:58:04.124959 14326 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:58:04.125418 14024 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 6. Current term is 7. Ops: []
I20261115 14:58:04.126292 14534 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:04.126557 14538 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:58:04.126556 14400 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb7b468eb37d4054b52193916a9a47eb; no voters: 20af9b506c3c4202822898b70849d240, c6a149406f4749cca582af0b8b0147f5
I20261115 14:58:04.127285 14537 raft_consensus.cc:2771] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:58:04.128420 14538 raft_consensus.cc:2771] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:58:04.288661 14534 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:04.289137 14534 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:04.290729 14534 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:04.291864 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:04.291838 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:04.292681 14024 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 7.
I20261115 14:58:04.292714 13947 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 7.
I20261115 14:58:04.293931 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:04.294631 14534 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20261115 14:58:04.295038 14534 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:58:04.295414 14534 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Advancing to term 8
I20261115 14:58:04.300927 14534 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:04.302939 14534 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:04.303725 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:04.304128 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:04.304265 13947 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Advancing to term 8
I20261115 14:58:04.304785 14021 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Advancing to term 8
I20261115 14:58:04.311892 13947 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 8.
I20261115 14:58:04.312675 14021 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 8.
I20261115 14:58:04.313220 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:04.314220 14534 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 FOLLOWER]: Leader election won for term 8
I20261115 14:58:04.314774 14534 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:04.315476 14534 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:04.320577 14021 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20261115 14:58:04.320577 13947 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20261115 14:58:04.322314 14531 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20261115 14:58:04.324013 14530 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20261115 14:58:04.331792 13679 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
W20261115 14:58:04.955577 14447 debug-util.cc:398] Leaking SignalData structure 0x7b080013a1a0 after lost signal to thread 12295
W20261115 14:58:04.956729 14447 debug-util.cc:398] Leaking SignalData structure 0x7b0800093260 after lost signal to thread 13713
W20261115 14:58:04.957816 14447 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1be0 after lost signal to thread 13972
W20261115 14:58:04.959018 14447 debug-util.cc:398] Leaking SignalData structure 0x7b08001300e0 after lost signal to thread 14050
W20261115 14:58:04.959964 14447 debug-util.cc:398] Leaking SignalData structure 0x7b080012ac40 after lost signal to thread 14128
W20261115 14:58:04.960897 14447 debug-util.cc:398] Leaking SignalData structure 0x7b080021a4c0 after lost signal to thread 14351
W20261115 14:58:04.961870 14447 debug-util.cc:398] Leaking SignalData structure 0x7b080021bd00 after lost signal to thread 14450
I20261115 14:58:16.560508 14582 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:16.559991 14580 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.561985 14582 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.563247 14580 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.566089 14582 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.566771 14584 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.566767 14582 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.561236 14581 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:58:16.567605 14582 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:16.567538 14584 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:16.567775 14581 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:16.570015 14582 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.570714 14584 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:16.571252 14584 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.571663 14584 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.573728 14584 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.575070 14580 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.576683 14581 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:58:16.611362 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.612181 14103 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 3.
I20261115 14:58:16.613950 13991 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:16.614898 14580 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261115 14:58:16.615283 14580 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:16.615526 14580 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:58:16.625605 14580 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.627748 14580 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.628861 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:16.629462 14103 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:58:16.632213 14101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.636693 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240" is_pre_election: true
I20261115 14:58:16.639904 14103 raft_consensus.cc:2490] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 4.
I20261115 14:58:16.641108 13991 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:16.642045 14580 raft_consensus.cc:2826] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Leader election won for term 4
I20261115 14:58:16.642935 14580 raft_consensus.cc:705] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Becoming Leader. State: Replica: 4386ed1ad6b443ef9186a4c8218b2f44, State: Running, Role: LEADER
I20261115 14:58:16.644677 14024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:16.645325 14024 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 8.
I20261115 14:58:16.645665 13945 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:16.646148 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:16.646327 13945 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 8.
I20261115 14:58:16.646766 14021 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 6.
I20261115 14:58:16.647330 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:58:16.647667 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:16.647256 14580 consensus_queue.cc:238] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.647874 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:16.648773 13992 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:16.649706 14583 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20261115 14:58:16.649789 14584 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20261115 14:58:16.650211 14583 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.650689 14583 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 8 FOLLOWER]: Advancing to term 9
I20261115 14:58:16.650398 14584 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.652964 14584 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 8 FOLLOWER]: Advancing to term 9
I20261115 14:58:16.663028 14102 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.665383 14327 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:58:16.665127 14584 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:16.666038 14327 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7b468eb37d4054b52193916a9a47eb in term 4.
I20261115 14:58:16.666353 13948 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 8. Current term is 9. Ops: []
I20261115 14:58:16.667275 13911 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:58:16.668231 14569 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20261115 14:58:16.667745 14400 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb; no voters: 20af9b506c3c4202822898b70849d240
I20261115 14:58:16.668977 14584 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 9 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:16.669447 14581 raft_consensus.cc:2826] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20261115 14:58:16.669811 14581 raft_consensus.cc:499] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20af9b506c3c4202822898b70849d240)
I20261115 14:58:16.670158 14581 raft_consensus.cc:3096] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:58:16.668578 14569 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.670475 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:16.670789 14569 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:16.671916 14583 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:16.673098 14021 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25a1f4bd36e14df983b98a471f53f937 in current term 9: Already voted for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in this term.
I20261115 14:58:16.674120 14583 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 9 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.674746 13947 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:16.677201 14102 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:16.677567 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:16.678402 14581 raft_consensus.cc:521] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:16.679080 13991 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:16.679253 13992 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:16.679957 14582 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20261115 14:58:16.680218 14583 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261115 14:58:16.681740 13689 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "20af9b506c3c4202822898b70849d240"
I20261115 14:58:16.683084 14327 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb7b468eb37d4054b52193916a9a47eb" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5"
I20261115 14:58:16.683720 14327 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:58:16.686244 14024 raft_consensus.cc:1250] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 3. Current term is 4. Ops: []
I20261115 14:58:16.686321 14581 leader_election.cc:290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 election: Requested vote from peers 20af9b506c3c4202822898b70849d240 (127.12.1.62:35143), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:58:16.687897 14102 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20261115 14:58:16.689497 14580 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20261115 14:58:16.691167 14327 raft_consensus.cc:2490] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7b468eb37d4054b52193916a9a47eb in term 5.
I20261115 14:58:16.692106 14326 raft_consensus.cc:1250] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Rejecting Update request from peer 20af9b506c3c4202822898b70849d240 for earlier term 4. Current term is 5. Ops: []
I20261115 14:58:16.692381 13946 raft_consensus.cc:3091] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 LEADER]: Stepping down as leader of term 3
I20261115 14:58:16.692759 13946 raft_consensus.cc:748] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:58:16.697655 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.698662 14569 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.699651 14585 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20261115 14:58:16.702109 14585 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 LEADER]: Stepping down as leader of term 8
I20261115 14:58:16.702481 14585 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:16.692555 14400 leader_election.cc:304] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb; no voters: 20af9b506c3c4202822898b70849d240
W20261115 14:58:16.765722 14400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.1.60:43497, user_credentials={real_user=slave}} blocked reactor thread for 73270us
I20261115 14:58:16.766608 14581 raft_consensus.cc:2826] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 FOLLOWER]: Leader election won for term 5
I20261115 14:58:16.768617 14581 raft_consensus.cc:705] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 LEADER]: Becoming Leader. State: Replica: eb7b468eb37d4054b52193916a9a47eb, State: Running, Role: LEADER
I20261115 14:58:16.769572 14581 consensus_queue.cc:238] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 4.24, Last appended by leader: 24, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:16.705591 14585 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:16.724956 14102 raft_consensus.cc:1250] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 3. Current term is 4. Ops: []
I20261115 14:58:16.772501 13948 raft_consensus.cc:1250] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 6. Current term is 7. Ops: []
I20261115 14:58:16.725363 14101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.726177 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:16.693665 13946 consensus_queue.cc:261] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.731578 14586 consensus_queue.cc:1060] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 }, Status: INVALID_TERM, Last received: 4.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20261115 14:58:16.750785 14022 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 8. Current term is 9. Ops: []
I20261115 14:58:16.775534 13946 raft_consensus.cc:3096] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 3 FOLLOWER]: Advancing to term 4
I20261115 14:58:16.762418 14569 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 election: Requested vote from peers 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.762775 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:16.781747 13946 raft_consensus.cc:1285] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Refusing update from remote peer 4386ed1ad6b443ef9186a4c8218b2f44: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20261115 14:58:16.783139 14580 consensus_queue.cc:1049] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20261115 14:58:16.784696 14575 consensus_queue.cc:1060] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20261115 14:58:16.788125 13678 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 3 to 4, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2). New cstate: current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } }
I20261115 14:58:16.798374 14326 raft_consensus.cc:1285] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Refusing update from remote peer eb7b468eb37d4054b52193916a9a47eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 24. Preceding OpId from leader: term: 5 index: 25. (index mismatch)
I20261115 14:58:16.818192 14425 raft_consensus.cc:1250] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 LEADER]: Rejecting Update request from peer 20af9b506c3c4202822898b70849d240 for earlier term 4. Current term is 5. Ops: []
I20261115 14:58:16.817610 14589 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:16.824322 14585 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 8 FOLLOWER]: Advancing to term 9
I20261115 14:58:16.826010 14579 raft_consensus.cc:3091] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Stepping down as leader of term 6
I20261115 14:58:16.828445 14579 raft_consensus.cc:748] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:16.829288 14592 raft_consensus.cc:3091] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 LEADER]: Stepping down as leader of term 4
I20261115 14:58:16.829923 14592 raft_consensus.cc:748] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20af9b506c3c4202822898b70849d240, State: Running, Role: LEADER
I20261115 14:58:16.829679 14579 consensus_queue.cc:261] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.832898 14101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:16.832451 14592 consensus_queue.cc:261] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 4.24, Last appended by leader: 24, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:16.835807 14586 consensus_queue.cc:1060] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 }, Status: INVALID_TERM, Last received: 4.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20261115 14:58:16.836633 14586 consensus_queue.cc:1247] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [NON_LEADER]: Peer eb7b468eb37d4054b52193916a9a47eb log is divergent from this leader: its last log entry 5.25 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 24
I20261115 14:58:16.836006 14595 consensus_queue.cc:1049] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.003s
I20261115 14:58:16.838102 14592 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 4 FOLLOWER]: Advancing to term 5
I20261115 14:58:16.833400 14589 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:16.852794 14579 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:16.855710 14103 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 9.
I20261115 14:58:16.860634 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:16.865760 14584 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 FOLLOWER]: Leader election won for term 9
I20261115 14:58:16.866895 14584 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:58:16.867758 14584 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
E20261115 14:58:16.874465 13678 catalog_manager.cc:6003] Error updating tablets from 70a8e5bf3f114973a6c79283747a896e: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.054s ago.. Tablet report was: is_incremental: true updated_tablets { tablet_id: "7cc15882957b4b0e8cce33725af756c9" state: RUNNING consensus_state { current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } sequence_number: 232
I20261115 14:58:16.881502 13679 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 reported cstate change: term changed from 3 to 4, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2). New cstate: current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } }
I20261115 14:58:16.885288 13689 raft_consensus.cc:1285] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Refusing update from remote peer eb7b468eb37d4054b52193916a9a47eb: Log matching property violated. Preceding OpId in replica: term: 4 index: 24. Preceding OpId from leader: term: 5 index: 25. (index mismatch)
I20261115 14:58:16.890842 14589 consensus_queue.cc:1049] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20261115 14:58:16.891247 14101 raft_consensus.cc:2490] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 7.
E20261115 14:58:16.892477 13679 catalog_manager.cc:6003] Error updating tablets from 4386ed1ad6b443ef9186a4c8218b2f44: Illegal state: replica 20af9b506c3c4202822898b70849d240 is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "7cc15882957b4b0e8cce33725af756c9" state: RUNNING consensus_state { current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 8415974 live_row_count: 26 } } sequence_number: 238
I20261115 14:58:16.897054 14603 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:16.903491 14580 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:16.916548 14580 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.922199 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:16.923302 13946 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 7: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:58:16.925019 13913 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:16.926419 14569 raft_consensus.cc:2826] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Leader election won for term 7
I20261115 14:58:16.922199 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "29835c96f20f4c939ceb0a7178e3cf6d" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:16.929382 14103 raft_consensus.cc:2415] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 7: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:58:16.922350 14580 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:16.930945 13992 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:16.931295 14569 raft_consensus.cc:705] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 LEADER]: Becoming Leader. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:58:16.931859 14580 raft_consensus.cc:3096] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 6 FOLLOWER]: Advancing to term 7
I20261115 14:58:16.932590 14569 consensus_queue.cc:238] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:16.934396 14603 catalog_manager.cc:694] Loaded metadata for table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed]
I20261115 14:58:16.939819 14580 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261115 14:58:16.942636 14603 tablet_loader.cc:96] loaded metadata for tablet 29835c96f20f4c939ceb0a7178e3cf6d (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:58:16.943883 14603 tablet_loader.cc:96] loaded metadata for tablet 5e8d40cde69448e4b68954f340023550 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:58:16.945235 14603 tablet_loader.cc:96] loaded metadata for tablet 7cc15882957b4b0e8cce33725af756c9 (table NewTableName [id=a0aaccfd41d84d2e9a85e37d6bbc6eed])
I20261115 14:58:16.949081 14603 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:16.950057 14604 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:16.950793 14604 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:58:16.952459 14103 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20261115 14:58:16.953538 14603 catalog_manager.cc:1310] Loaded cluster ID: 5e2fcfafbbdc4b449c18ff49b6346dff
I20261115 14:58:16.953894 14603 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:16.961199 14603 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:16.966001 14598 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:16.966718 14598 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:16.966694 14603 catalog_manager.cc:6232] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb: Loaded TSK: 0
I20261115 14:58:16.968393 14603 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:16.992995 14022 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20261115 14:58:16.997936 14024 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20261115 14:58:17.001543 14103 raft_consensus.cc:1285] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Refusing update from remote peer 25a1f4bd36e14df983b98a471f53f937: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20261115 14:58:17.004796 14583 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:17.008967 14604 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:17.010228 14604 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:58:17.012630 14583 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.007444 14592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7b468eb37d4054b52193916a9a47eb. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:17.017367 14592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:58:17.020063 14592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:17.021173 14592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [sys.catalog]: This master's current role is: FOLLOWER
I20261115 14:58:17.022317 14416 catalog_manager.cc:5840] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 3 to 4, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2). New cstate: current_term: 4 leader_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } }
I20261115 14:58:17.024770 14583 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:17.013303 14584 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20261115 14:58:17.025796 14569 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20261115 14:58:17.026738 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:17.014705 14589 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "eb7b468eb37d4054b52193916a9a47eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } } }
I20261115 14:58:17.027858 14589 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:17.026885 14609 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20261115 14:58:17.028631 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:17.028928 14569 consensus_queue.cc:1049] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20261115 14:58:17.029420 14103 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in term 9.
I20261115 14:58:17.024662 14416 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 reported cstate change: term changed from 8 to 9, leader changed from 70a8e5bf3f114973a6c79283747a896e (127.12.1.3) to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 9 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:58:17.031433 13991 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937
I20261115 14:58:17.034298 14052 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:58:17.035475 14130 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:58:17.037220 14580 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20261115 14:58:17.049077 14580 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:17.060467 14580 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 9 FOLLOWER]: Advancing to term 10
I20261115 14:58:17.079141 14580 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.083102 14024 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Rejecting Update request from peer 25a1f4bd36e14df983b98a471f53f937 for earlier term 9. Current term is 10. Ops: []
I20261115 14:58:17.100456 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:17.101315 14584 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20261115 14:58:17.111160 14580 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 10 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:17.115759 14611 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 LEADER]: Stepping down as leader of term 9
I20261115 14:58:17.116209 14611 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25a1f4bd36e14df983b98a471f53f937, State: Running, Role: LEADER
I20261115 14:58:17.117224 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:17.117089 14611 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.123718 14611 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 9 FOLLOWER]: Advancing to term 10
I20261115 14:58:17.123952 13991 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:17.126441 13974 heartbeater.cc:500] Master 127.12.1.61:44723 was elected leader, sending a full tablet report...
I20261115 14:58:17.125929 14415 catalog_manager.cc:5840] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 6 to 7, leader changed from 70a8e5bf3f114973a6c79283747a896e (127.12.1.3) to 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1). New cstate: current_term: 7 leader_uuid: "25a1f4bd36e14df983b98a471f53f937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } }
I20261115 14:58:17.129778 14580 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20261115 14:58:17.275038 14579 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:17.275527 14579 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.277953 14579 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:17.278857 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:17.279065 14022 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:17.279389 13946 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 10.
I20261115 14:58:17.279860 14022 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 10: Already voted for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in this term.
I20261115 14:58:17.280629 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:17.281369 14579 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20261115 14:58:17.281634 14579 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:17.281867 14579 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 9 FOLLOWER]: Advancing to term 10
I20261115 14:58:17.286866 14579 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.288609 14579 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 10 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:17.289309 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:17.289601 14022 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:17.290309 14022 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 70a8e5bf3f114973a6c79283747a896e in current term 10: Already voted for candidate 4386ed1ad6b443ef9186a4c8218b2f44 in this term.
I20261115 14:58:17.294224 13946 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 10.
I20261115 14:58:17.295264 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:17.295972 14579 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 FOLLOWER]: Leader election won for term 10
I20261115 14:58:17.296504 14579 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:17.297333 14579 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:17.301926 13946 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20261115 14:58:17.303382 14579 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20261115 14:58:17.304675 14022 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20261115 14:58:17.304951 14415 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 9 to 10, leader changed from 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1) to 70a8e5bf3f114973a6c79283747a896e (127.12.1.3). New cstate: current_term: 10 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:58:17.306246 14579 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20261115 14:58:17.720584 14348 debug-util.cc:398] Leaking SignalData structure 0x7b08000df940 after lost signal to thread 12295
W20261115 14:58:17.722018 14348 debug-util.cc:398] Leaking SignalData structure 0x7b080015a2a0 after lost signal to thread 13713
W20261115 14:58:17.723500 14348 debug-util.cc:398] Leaking SignalData structure 0x7b0800259680 after lost signal to thread 13972
W20261115 14:58:17.724852 14348 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba740 after lost signal to thread 14050
W20261115 14:58:17.725927 14348 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9a60 after lost signal to thread 14128
W20261115 14:58:17.726856 14348 debug-util.cc:398] Leaking SignalData structure 0x7b0800045740 after lost signal to thread 14351
W20261115 14:58:17.727895 14348 debug-util.cc:398] Leaking SignalData structure 0x7b080025a000 after lost signal to thread 14450
I20261115 14:58:17.966292 14579 raft_consensus.cc:499] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4386ed1ad6b443ef9186a4c8218b2f44)
I20261115 14:58:17.967061 14579 raft_consensus.cc:521] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:17.971588 14579 leader_election.cc:290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:18.118427 14611 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:18.119098 14611 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.121501 14611 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:18.171797 14022 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:18.172577 14022 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a1f4bd36e14df983b98a471f53f937 in term 10.
I20261115 14:58:18.174563 13911 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 
I20261115 14:58:18.175448 14611 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20261115 14:58:18.175812 14611 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:18.176190 14611 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 10 FOLLOWER]: Advancing to term 11
I20261115 14:58:18.180771 14621 raft_consensus.cc:499] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb7b468eb37d4054b52193916a9a47eb)
I20261115 14:58:18.181448 14621 raft_consensus.cc:521] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20af9b506c3c4202822898b70849d240" member_type: VOTER last_known_addr { host: "127.12.1.62" port: 35143 } } peers { permanent_uuid: "eb7b468eb37d4054b52193916a9a47eb" member_type: VOTER last_known_addr { host: "127.12.1.61" port: 44723 } } peers { permanent_uuid: "c6a149406f4749cca582af0b8b0147f5" member_type: VOTER last_known_addr { host: "127.12.1.60" port: 43497 } }
I20261115 14:58:18.185645 14621 leader_election.cc:290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb7b468eb37d4054b52193916a9a47eb (127.12.1.61:44723), c6a149406f4749cca582af0b8b0147f5 (127.12.1.60:43497)
I20261115 14:58:18.185964 14326 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "c6a149406f4749cca582af0b8b0147f5" is_pre_election: true
I20261115 14:58:18.190116 14611 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.192008 14611 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 11 election: Requested vote from peers 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:18.194463 14022 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:18.198076 13946 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:18.198822 14425 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20af9b506c3c4202822898b70849d240" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "eb7b468eb37d4054b52193916a9a47eb" is_pre_election: true
I20261115 14:58:18.200805 13664 leader_election.cc:304] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20af9b506c3c4202822898b70849d240; no voters: c6a149406f4749cca582af0b8b0147f5, eb7b468eb37d4054b52193916a9a47eb
I20261115 14:58:18.206091 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e"
I20261115 14:58:18.206475 13948 raft_consensus.cc:1250] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Rejecting Update request from peer 70a8e5bf3f114973a6c79283747a896e for earlier term 10. Current term is 11. Ops: []
I20261115 14:58:18.201969 14621 raft_consensus.cc:2771] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20261115 14:58:18.254221 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:18.343086 14103 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "25a1f4bd36e14df983b98a471f53f937" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
W20261115 14:58:18.366415 14067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.1.2:46463 timed out after 0.299s (SENT) [suppressed 11 similar messages]
I20261115 14:58:18.367827 13913 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937; no voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:18.368824 14611 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20261115 14:58:18.373087 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "7cc15882957b4b0e8cce33725af756c9" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:18.374783 14067 leader_election.cc:304] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:18.387431 14579 consensus_queue.cc:1060] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20261115 14:58:18.388450 14624 raft_consensus.cc:2771] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20261115 14:58:18.392483 14583 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 70a8e5bf3f114973a6c79283747a896e)
I20261115 14:58:18.393209 14583 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.396759 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:18.397353 14583 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 70a8e5bf3f114973a6c79283747a896e (127.12.1.3:38363)
I20261115 14:58:18.397576 13948 raft_consensus.cc:2415] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4386ed1ad6b443ef9186a4c8218b2f44 in current term 11: Already voted for candidate 25a1f4bd36e14df983b98a471f53f937 in this term.
I20261115 14:58:18.397925 14104 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "70a8e5bf3f114973a6c79283747a896e" is_pre_election: true
I20261115 14:58:18.399041 14624 raft_consensus.cc:3091] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 LEADER]: Stepping down as leader of term 10
I20261115 14:58:18.399283 13991 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44; no voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e
I20261115 14:58:18.399431 14624 raft_consensus.cc:748] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:18.400499 14583 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 10 FOLLOWER]: Advancing to term 11
I20261115 14:58:18.400364 14624 consensus_queue.cc:261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.402032 14624 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 10 FOLLOWER]: Advancing to term 11
I20261115 14:58:18.408802 14583 raft_consensus.cc:2771] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20261115 14:58:18.581697 14624 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:18.582315 14624 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.585706 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" is_pre_election: true
I20261115 14:58:18.585749 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937" is_pre_election: true
I20261115 14:58:18.586442 14021 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 11.
I20261115 14:58:18.586823 13948 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 11.
I20261115 14:58:18.585822 14624 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:18.587638 14067 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4386ed1ad6b443ef9186a4c8218b2f44, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:18.589087 14624 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20261115 14:58:18.589473 14624 raft_consensus.cc:499] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:58:18.589829 14624 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 11 FOLLOWER]: Advancing to term 12
I20261115 14:58:18.597815 14624 raft_consensus.cc:521] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.600050 14624 leader_election.cc:290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 12 election: Requested vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
I20261115 14:58:18.600674 13948 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25a1f4bd36e14df983b98a471f53f937"
I20261115 14:58:18.601241 13948 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 11 FOLLOWER]: Advancing to term 12
I20261115 14:58:18.601096 14021 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5e8d40cde69448e4b68954f340023550" candidate_uuid: "70a8e5bf3f114973a6c79283747a896e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4386ed1ad6b443ef9186a4c8218b2f44"
I20261115 14:58:18.601776 14021 raft_consensus.cc:3096] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 11 FOLLOWER]: Advancing to term 12
I20261115 14:58:18.607126 13948 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 12.
I20261115 14:58:18.608877 14021 raft_consensus.cc:2490] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a8e5bf3f114973a6c79283747a896e in term 12.
I20261115 14:58:18.609349 14070 leader_election.cc:304] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a1f4bd36e14df983b98a471f53f937, 70a8e5bf3f114973a6c79283747a896e; no voters: 
I20261115 14:58:18.611050 14624 raft_consensus.cc:2826] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 FOLLOWER]: Leader election won for term 12
I20261115 14:58:18.611543 14624 raft_consensus.cc:705] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 LEADER]: Becoming Leader. State: Replica: 70a8e5bf3f114973a6c79283747a896e, State: Running, Role: LEADER
I20261115 14:58:18.612689 14624 consensus_queue.cc:238] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } }
I20261115 14:58:18.618991 13948 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20261115 14:58:18.622488 14579 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20261115 14:58:18.626106 14021 raft_consensus.cc:1285] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Refusing update from remote peer 70a8e5bf3f114973a6c79283747a896e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20261115 14:58:18.625850 14414 catalog_manager.cc:5840] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "70a8e5bf3f114973a6c79283747a896e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } health_report { overall_health: UNKNOWN } } }
I20261115 14:58:18.632293 14579 consensus_queue.cc:1049] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20261115 14:58:19.252979 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca0a0 after lost signal to thread 12295
W20261115 14:58:19.254045 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca800 after lost signal to thread 13713
W20261115 14:58:19.255088 14047 debug-util.cc:398] Leaking SignalData structure 0x7b0800257ea0 after lost signal to thread 13972
W20261115 14:58:19.256126 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba540 after lost signal to thread 14050
W20261115 14:58:19.257033 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ae0 after lost signal to thread 14128
W20261115 14:58:19.257860 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08001653e0 after lost signal to thread 14351
W20261115 14:58:19.258760 14047 debug-util.cc:398] Leaking SignalData structure 0x7b08001fbe00 after lost signal to thread 14450
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:784: Failure
Expected equality of these values:
  live_row_count
    Which is: 67
  table_info->GetMetrics()->live_row_count->value()
    Which is: 134
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:768: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:786: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 784, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
  Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:896: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20261115 14:58:26.159400 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
W20261115 14:58:26.163785 13992 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20261115 14:58:26.168682 13992 consensus_peers.cc:597] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 -> Peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Couldn't send request to peer 25a1f4bd36e14df983b98a471f53f937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.202621 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
W20261115 14:58:26.202669 14070 consensus_peers.cc:597] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e -> Peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Couldn't send request to peer 25a1f4bd36e14df983b98a471f53f937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.203594 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.204422 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.205389 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 25a1f4bd36e14df983b98a471f53f937 [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.207859 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.208335 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.208705 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 25a1f4bd36e14df983b98a471f53f937 [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.210474 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937: stopping tablet replica
I20261115 14:58:26.210831 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.211150 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 25a1f4bd36e14df983b98a471f53f937 [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.256417 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:26.279505 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
W20261115 14:58:26.316052 14067 consensus_peers.cc:597] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e -> Peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Couldn't send request to peer 4386ed1ad6b443ef9186a4c8218b2f44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:26.340801 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:26.341706 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.342487 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.343183 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 4386ed1ad6b443ef9186a4c8218b2f44 [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.345147 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.345846 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.346791 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.348706 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44: stopping tablet replica
I20261115 14:58:26.349311 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.349915 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 4386ed1ad6b443ef9186a4c8218b2f44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.395421 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:26.405782 14624 raft_consensus.cc:499] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25a1f4bd36e14df983b98a471f53f937)
I20261115 14:58:26.406286 14624 raft_consensus.cc:521] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25a1f4bd36e14df983b98a471f53f937" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35611 } } peers { permanent_uuid: "4386ed1ad6b443ef9186a4c8218b2f44" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 46463 } } peers { permanent_uuid: "70a8e5bf3f114973a6c79283747a896e" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 38363 } }
I20261115 14:58:26.416244 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
W20261115 14:58:26.416124 14070 leader_election.cc:336] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611): Network error: Client connection negotiation failed: client connection to 127.12.1.1:35611: connect: Connection refused (error 111)
I20261115 14:58:26.416728 14624 leader_election.cc:290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25a1f4bd36e14df983b98a471f53f937 (127.12.1.1:35611), 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463)
W20261115 14:58:26.420888 14067 leader_election.cc:336] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4386ed1ad6b443ef9186a4c8218b2f44 (127.12.1.2:46463): Network error: Client connection negotiation failed: client connection to 127.12.1.2:46463: connect: Connection refused (error 111)
I20261115 14:58:26.421439 14067 leader_election.cc:304] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70a8e5bf3f114973a6c79283747a896e; no voters: 25a1f4bd36e14df983b98a471f53f937, 4386ed1ad6b443ef9186a4c8218b2f44
I20261115 14:58:26.422215 14624 raft_consensus.cc:2771] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261115 14:58:26.447101 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:26.447813 12292 tablet_replica.cc:333] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.448415 12292 raft_consensus.cc:2261] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.448913 12292 raft_consensus.cc:2290] T 7cc15882957b4b0e8cce33725af756c9 P 70a8e5bf3f114973a6c79283747a896e [term 4 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.450817 12292 tablet_replica.cc:333] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.451267 12292 raft_consensus.cc:2261] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.451967 12292 raft_consensus.cc:2290] T 5e8d40cde69448e4b68954f340023550 P 70a8e5bf3f114973a6c79283747a896e [term 12 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.453711 12292 tablet_replica.cc:333] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e: stopping tablet replica
I20261115 14:58:26.454138 12292 raft_consensus.cc:2261] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.454535 12292 raft_consensus.cc:2290] T 29835c96f20f4c939ceb0a7178e3cf6d P 70a8e5bf3f114973a6c79283747a896e [term 7 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.500468 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:58:26.512758 12292 master.cc:585] Master@127.12.1.62:35143 shutting down...
I20261115 14:58:26.539557 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.540208 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240 [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.540556 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 20af9b506c3c4202822898b70849d240: stopping tablet replica
I20261115 14:58:26.561339 12292 master.cc:607] Master@127.12.1.62:35143 shutdown complete.
I20261115 14:58:26.579084 12292 master.cc:585] Master@127.12.1.61:44723 shutting down...
I20261115 14:58:26.601188 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 LEADER]: Raft consensus shutting down.
I20261115 14:58:26.601955 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P eb7b468eb37d4054b52193916a9a47eb [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.602432 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:26.643747 12292 master.cc:607] Master@127.12.1.61:44723 shutdown complete.
I20261115 14:58:26.659019 12292 master.cc:585] Master@127.12.1.60:43497 shutting down...
I20261115 14:58:26.678396 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:26.678906 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P c6a149406f4749cca582af0b8b0147f5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:26.679160 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:26.717007 12292 master.cc:607] Master@127.12.1.60:43497 shutdown complete.
I20261115 14:58:26.740732 12292 test_util.cc:182] -----------------------------------------------
I20261115 14:58:26.740954 12292 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1794754656521719-12292-0
[  FAILED  ] TsTabletManagerITest.TestTableStats (37278 ms)
[ RUN      ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20261115 14:58:26.747514 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:33259
I20261115 14:58:26.748718 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:26.753983 14676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:26.755208 14677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:26.756488 14679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:26.758052 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:26.761404 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:26.761580 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:26.761868 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754706761837 us; error 0 us; skew 500 ppm
I20261115 14:58:26.762486 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:26.764851 12292 webserver.cc:577] Webserver started at http://127.12.1.62:32833/ using document root <none> and password file <none>
I20261115 14:58:26.765332 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:26.765527 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:26.765786 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:26.766916 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "d52a0acf7b914e09970438b2add8074e"
format_stamp: "Formatted at 2026-11-15 14:58:26 on dist-test-slave-fhcn"
I20261115 14:58:26.771443 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20261115 14:58:26.774737 14684 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:26.775424 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:58:26.775740 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "d52a0acf7b914e09970438b2add8074e"
format_stamp: "Formatted at 2026-11-15 14:58:26 on dist-test-slave-fhcn"
I20261115 14:58:26.776008 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:26.802340 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:26.803629 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:26.841082 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:33259
I20261115 14:58:26.841207 14735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:33259 every 8 connection(s)
I20261115 14:58:26.844933 14736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:26.855319 14736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: Bootstrap starting.
I20261115 14:58:26.860344 14736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:26.864495 14736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: No bootstrap required, opened a new log
I20261115 14:58:26.866561 14736 raft_consensus.cc:360] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER }
I20261115 14:58:26.866914 14736 raft_consensus.cc:386] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:26.867091 14736 raft_consensus.cc:748] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d52a0acf7b914e09970438b2add8074e, State: Initialized, Role: FOLLOWER
I20261115 14:58:26.867576 14736 consensus_queue.cc:261] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER }
I20261115 14:58:26.867954 14736 raft_consensus.cc:400] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:26.868212 14736 raft_consensus.cc:499] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:26.868429 14736 raft_consensus.cc:3096] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:26.872668 14736 raft_consensus.cc:521] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER }
I20261115 14:58:26.873102 14736 leader_election.cc:304] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d52a0acf7b914e09970438b2add8074e; no voters: 
I20261115 14:58:26.874157 14736 leader_election.cc:290] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:26.874567 14739 raft_consensus.cc:2826] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:26.875931 14739 raft_consensus.cc:705] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 1 LEADER]: Becoming Leader. State: Replica: d52a0acf7b914e09970438b2add8074e, State: Running, Role: LEADER
I20261115 14:58:26.876592 14739 consensus_queue.cc:238] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER }
I20261115 14:58:26.877094 14736 sys_catalog.cc:565] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:26.880859 14740 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d52a0acf7b914e09970438b2add8074e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER } }
I20261115 14:58:26.881567 14740 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:26.881572 14741 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d52a0acf7b914e09970438b2add8074e. Latest consensus state: current_term: 1 leader_uuid: "d52a0acf7b914e09970438b2add8074e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a0acf7b914e09970438b2add8074e" member_type: VOTER } }
I20261115 14:58:26.882202 14741 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:26.883684 14745 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:26.888731 14745 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:26.894165 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:26.897660 14745 catalog_manager.cc:1398] Generated new cluster ID: c41836c6214949518b1eb213573e8cf7
I20261115 14:58:26.897981 14745 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:26.915356 14745 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:26.916632 14745 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:26.928610 14745 catalog_manager.cc:6221] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: Generated new TSK 0
I20261115 14:58:26.929200 14745 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:26.961040 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:26.967317 14757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:26.967622 14758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:26.969880 14760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:26.970737 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:26.971753 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:26.971976 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:26.972183 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754706972162 us; error 0 us; skew 500 ppm
I20261115 14:58:26.972708 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:26.975008 12292 webserver.cc:577] Webserver started at http://127.12.1.1:40619/ using document root <none> and password file <none>
I20261115 14:58:26.975525 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:26.975724 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:26.975989 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:26.977152 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "cc58c59798d94b78aab389bded74e5da"
format_stamp: "Formatted at 2026-11-15 14:58:26 on dist-test-slave-fhcn"
I20261115 14:58:26.982089 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20261115 14:58:26.985651 14765 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:26.986539 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261115 14:58:26.986794 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "cc58c59798d94b78aab389bded74e5da"
format_stamp: "Formatted at 2026-11-15 14:58:26 on dist-test-slave-fhcn"
I20261115 14:58:26.987039 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:27.001958 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:27.003117 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:27.004581 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:27.006879 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:27.007061 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.007335 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:27.007499 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.068704 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:35969
I20261115 14:58:27.068849 14828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:35969 every 8 connection(s)
I20261115 14:58:27.075762 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:27.085112 14833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:27.086076 14834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:27.091454 14829 heartbeater.cc:345] Connected to a master server at 127.12.1.62:33259
I20261115 14:58:27.091676 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:27.091914 14829 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:27.092816 14829 heartbeater.cc:508] Master 127.12.1.62:33259 requested a full tablet report, sending...
W20261115 14:58:27.093323 14836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:27.094251 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:27.094578 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:27.094823 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754707094799 us; error 0 us; skew 500 ppm
I20261115 14:58:27.095420 14701 ts_manager.cc:210] Registered new tserver with Master: cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969)
I20261115 14:58:27.095671 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:27.098302 14701 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38682
I20261115 14:58:27.099234 12292 webserver.cc:577] Webserver started at http://127.12.1.2:37925/ using document root <none> and password file <none>
I20261115 14:58:27.099982 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:27.100287 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:27.100647 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:27.102131 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "f564cfdfb7214d56ae476a6a9b0ddded"
format_stamp: "Formatted at 2026-11-15 14:58:27 on dist-test-slave-fhcn"
I20261115 14:58:27.107142 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20261115 14:58:27.110741 14841 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.111512 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:58:27.111822 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "f564cfdfb7214d56ae476a6a9b0ddded"
format_stamp: "Formatted at 2026-11-15 14:58:27 on dist-test-slave-fhcn"
I20261115 14:58:27.112147 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:27.130839 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:27.132231 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:27.133714 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:27.136018 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:27.136283 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.136546 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:27.136736 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.176520 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:39265
I20261115 14:58:27.176635 14903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:39265 every 8 connection(s)
I20261115 14:58:27.181751 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:27.189452 14907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:27.191690 14908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:27.192448 14910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:27.194938 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:27.195993 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20261115 14:58:27.196146 14904 heartbeater.cc:345] Connected to a master server at 127.12.1.62:33259
W20261115 14:58:27.196305 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:27.196593 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754707196575 us; error 0 us; skew 500 ppm
I20261115 14:58:27.196646 14904 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:27.197208 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:27.197536 14904 heartbeater.cc:508] Master 127.12.1.62:33259 requested a full tablet report, sending...
I20261115 14:58:27.199780 14701 ts_manager.cc:210] Registered new tserver with Master: f564cfdfb7214d56ae476a6a9b0ddded (127.12.1.2:39265)
I20261115 14:58:27.200033 12292 webserver.cc:577] Webserver started at http://127.12.1.3:41927/ using document root <none> and password file <none>
I20261115 14:58:27.200913 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:27.201162 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:27.201495 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:27.201807 14701 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38696
I20261115 14:58:27.203105 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root/instance:
uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628"
format_stamp: "Formatted at 2026-11-15 14:58:27 on dist-test-slave-fhcn"
I20261115 14:58:27.207743 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20261115 14:58:27.211126 14915 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.211854 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:27.212172 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root
uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628"
format_stamp: "Formatted at 2026-11-15 14:58:27 on dist-test-slave-fhcn"
I20261115 14:58:27.212464 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:27.229612 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:27.230875 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:27.232317 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:27.234526 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:27.234740 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.234980 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:27.235148 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:27.275041 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.3:34517
I20261115 14:58:27.275141 14977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.3:34517 every 8 connection(s)
I20261115 14:58:27.288987 14978 heartbeater.cc:345] Connected to a master server at 127.12.1.62:33259
I20261115 14:58:27.289368 14978 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:27.290092 14978 heartbeater.cc:508] Master 127.12.1.62:33259 requested a full tablet report, sending...
I20261115 14:58:27.291957 14701 ts_manager.cc:210] Registered new tserver with Master: ea7a12a8ea454bb8bb35a9ae0f10e628 (127.12.1.3:34517)
I20261115 14:58:27.292726 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014378588s
I20261115 14:58:27.293345 14701 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38710
I20261115 14:58:27.326956 14701 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38718:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
  }
}
W20261115 14:58:27.328744 14701 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261115 14:58:27.373198 14943 tablet_service.cc:1500] Processing CreateTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 (DEFAULT_TABLE table=test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]), partition=
I20261115 14:58:27.374414 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4ccc8a0dd4e56846f380b81957b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:27.376156 14869 tablet_service.cc:1500] Processing CreateTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 (DEFAULT_TABLE table=test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]), partition=
I20261115 14:58:27.377331 14869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4ccc8a0dd4e56846f380b81957b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:27.384626 14794 tablet_service.cc:1500] Processing CreateTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 (DEFAULT_TABLE table=test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]), partition=
I20261115 14:58:27.385954 14794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4ccc8a0dd4e56846f380b81957b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:27.397810 14994 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Bootstrap starting.
I20261115 14:58:27.399303 14995 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Bootstrap starting.
I20261115 14:58:27.400857 14996 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Bootstrap starting.
I20261115 14:58:27.405542 14995 tablet_bootstrap.cc:654] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:27.405997 14994 tablet_bootstrap.cc:654] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:27.408391 14996 tablet_bootstrap.cc:654] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:27.410846 14995 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: No bootstrap required, opened a new log
I20261115 14:58:27.411269 14995 ts_tablet_manager.cc:1449] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.007s
I20261115 14:58:27.412001 14994 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: No bootstrap required, opened a new log
I20261115 14:58:27.412472 14994 ts_tablet_manager.cc:1449] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20261115 14:58:27.413976 14996 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: No bootstrap required, opened a new log
I20261115 14:58:27.414650 14996 ts_tablet_manager.cc:1449] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20261115 14:58:27.414173 14995 raft_consensus.cc:360] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.415243 14995 raft_consensus.cc:386] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:27.415536 14995 raft_consensus.cc:748] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea7a12a8ea454bb8bb35a9ae0f10e628, State: Initialized, Role: FOLLOWER
I20261115 14:58:27.415709 14994 raft_consensus.cc:360] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.416589 14994 raft_consensus.cc:386] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:27.416507 14995 consensus_queue.cc:261] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.417089 14994 raft_consensus.cc:748] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f564cfdfb7214d56ae476a6a9b0ddded, State: Initialized, Role: FOLLOWER
I20261115 14:58:27.417817 14996 raft_consensus.cc:360] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.418203 14994 consensus_queue.cc:261] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.418635 14996 raft_consensus.cc:386] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:27.419118 14996 raft_consensus.cc:748] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc58c59798d94b78aab389bded74e5da, State: Initialized, Role: FOLLOWER
I20261115 14:58:27.419926 14978 heartbeater.cc:500] Master 127.12.1.62:33259 was elected leader, sending a full tablet report...
I20261115 14:58:27.420820 14995 ts_tablet_manager.cc:1480] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
W20261115 14:58:27.421135 14995 ts_tablet_manager.cc:1503] Injecting 50ms of latency into OpenTablet
I20261115 14:58:27.420331 14996 consensus_queue.cc:261] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.428406 14829 heartbeater.cc:500] Master 127.12.1.62:33259 was elected leader, sending a full tablet report...
I20261115 14:58:27.429324 14904 heartbeater.cc:500] Master 127.12.1.62:33259 was elected leader, sending a full tablet report...
I20261115 14:58:27.429893 14994 ts_tablet_manager.cc:1480] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20261115 14:58:27.429925 14996 ts_tablet_manager.cc:1480] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
W20261115 14:58:27.430366 14994 ts_tablet_manager.cc:1503] Injecting 50ms of latency into OpenTablet
W20261115 14:58:27.430500 14996 ts_tablet_manager.cc:1503] Injecting 50ms of latency into OpenTablet
W20261115 14:58:27.430861 14905 tablet.cc:2441] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261115 14:58:27.462980 15000 raft_consensus.cc:499] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:27.463603 15000 raft_consensus.cc:521] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.465637 15000 leader_election.cc:290] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f564cfdfb7214d56ae476a6a9b0ddded (127.12.1.2:39265), cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969)
I20261115 14:58:27.476927 14879 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "64c4ccc8a0dd4e56846f380b81957b61" candidate_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" is_pre_election: true
I20261115 14:58:27.477793 14879 raft_consensus.cc:2490] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea7a12a8ea454bb8bb35a9ae0f10e628 in term 0.
I20261115 14:58:27.478674 14804 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "64c4ccc8a0dd4e56846f380b81957b61" candidate_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc58c59798d94b78aab389bded74e5da" is_pre_election: true
I20261115 14:58:27.479393 14804 raft_consensus.cc:2490] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea7a12a8ea454bb8bb35a9ae0f10e628 in term 0.
I20261115 14:58:27.479321 14917 leader_election.cc:304] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea7a12a8ea454bb8bb35a9ae0f10e628, f564cfdfb7214d56ae476a6a9b0ddded; no voters: 
I20261115 14:58:27.481200 15000 raft_consensus.cc:2826] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:58:27.481585 15000 raft_consensus.cc:499] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:58:27.481936 15000 raft_consensus.cc:3096] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:27.489264 15000 raft_consensus.cc:521] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.490919 15000 leader_election.cc:290] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [CANDIDATE]: Term 1 election: Requested vote from peers f564cfdfb7214d56ae476a6a9b0ddded (127.12.1.2:39265), cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969)
I20261115 14:58:27.491638 14879 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "64c4ccc8a0dd4e56846f380b81957b61" candidate_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f564cfdfb7214d56ae476a6a9b0ddded"
I20261115 14:58:27.492003 14804 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "64c4ccc8a0dd4e56846f380b81957b61" candidate_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc58c59798d94b78aab389bded74e5da"
I20261115 14:58:27.492192 14879 raft_consensus.cc:3096] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:27.492558 14804 raft_consensus.cc:3096] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:27.497922 14879 raft_consensus.cc:2490] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea7a12a8ea454bb8bb35a9ae0f10e628 in term 1.
I20261115 14:58:27.497906 14804 raft_consensus.cc:2490] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea7a12a8ea454bb8bb35a9ae0f10e628 in term 1.
I20261115 14:58:27.499325 14917 leader_election.cc:304] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea7a12a8ea454bb8bb35a9ae0f10e628, f564cfdfb7214d56ae476a6a9b0ddded; no voters: 
I20261115 14:58:27.500248 15000 raft_consensus.cc:2826] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:27.501215 15000 raft_consensus.cc:705] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 1 LEADER]: Becoming Leader. State: Replica: ea7a12a8ea454bb8bb35a9ae0f10e628, State: Running, Role: LEADER
I20261115 14:58:27.501950 15000 consensus_queue.cc:238] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.508944 15000 consensus_queue.cc:1049] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:58:27.510650 15000 consensus_queue.cc:1049] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:58:27.511255 14700 catalog_manager.cc:5840] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea7a12a8ea454bb8bb35a9ae0f10e628 (127.12.1.3). New cstate: current_term: 1 leader_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20261115 14:58:27.584762 14794 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:41558
I20261115 14:58:27.586670 15013 tablet_replica.cc:333] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: stopping tablet replica
I20261115 14:58:27.587262 15013 raft_consensus.cc:2261] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:27.587693 15013 raft_consensus.cc:2290] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:27.590606 15013 ts_tablet_manager.cc:1962] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20261115 14:58:27.601066 15013 ts_tablet_manager.cc:1975] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20261115 14:58:27.601441 15013 log.cc:1199] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root/wals/64c4ccc8a0dd4e56846f380b81957b61
I20261115 14:58:27.605648 15014 ts_tablet_manager.cc:979] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Initiating tablet copy from peer ea7a12a8ea454bb8bb35a9ae0f10e628 (127.12.1.3:34517)
I20261115 14:58:27.607280 15014 tablet_copy_client.cc:323] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.3:34517
I20261115 14:58:27.617173 14963 tablet_copy_service.cc:140] P ea7a12a8ea454bb8bb35a9ae0f10e628: Received BeginTabletCopySession request for tablet 64c4ccc8a0dd4e56846f380b81957b61 from peer cc58c59798d94b78aab389bded74e5da ({username='slave'} at 127.0.0.1:59388)
I20261115 14:58:27.617698 14963 tablet_copy_service.cc:161] P ea7a12a8ea454bb8bb35a9ae0f10e628: Beginning new tablet copy session on tablet 64c4ccc8a0dd4e56846f380b81957b61 from peer cc58c59798d94b78aab389bded74e5da at {username='slave'} at 127.0.0.1:59388: session id = cc58c59798d94b78aab389bded74e5da-64c4ccc8a0dd4e56846f380b81957b61
I20261115 14:58:27.622998 14963 tablet_copy_source_session.cc:215] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Tablet Copy: opened 0 blocks and 1 log segments
I20261115 14:58:27.625662 15014 ts_tablet_manager.cc:1962] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting tablet data with delete state TABLET_DATA_COPYING
I20261115 14:58:27.635241 15014 ts_tablet_manager.cc:1975] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20261115 14:58:27.635895 15014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4ccc8a0dd4e56846f380b81957b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:27.641453 15014 tablet_copy_client.cc:806] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet copy: Starting download of 0 data blocks...
I20261115 14:58:27.641995 15014 tablet_copy_client.cc:670] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet copy: Starting download of 1 WAL segments...
I20261115 14:58:27.643821 14701 catalog_manager.cc:2548] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38734:
table { table_id: "72648f1dae2f4da58e2c3cb02bbf8b03" table_name: "test-table" }
I20261115 14:58:27.644564 14701 catalog_manager.cc:2796] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38734:
table { table_id: "72648f1dae2f4da58e2c3cb02bbf8b03" table_name: "test-table" }
I20261115 14:58:27.646270 15014 tablet_copy_client.cc:538] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261115 14:58:27.653671 15014 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Bootstrap starting.
I20261115 14:58:27.655340 14701 catalog_manager.cc:6135] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: Sending DeleteTablet for 3 replicas of tablet 64c4ccc8a0dd4e56846f380b81957b61
I20261115 14:58:27.657641 14869 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-15 14:58:27 UTC) from {username='slave'} at 127.0.0.1:60674
I20261115 14:58:27.658263 14943 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-15 14:58:27 UTC) from {username='slave'} at 127.0.0.1:59372
I20261115 14:58:27.660239 14794 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-15 14:58:27 UTC) from {username='slave'} at 127.0.0.1:41548
I20261115 14:58:27.661182 15018 tablet_replica.cc:333] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: stopping tablet replica
I20261115 14:58:27.661693 15017 tablet_replica.cc:333] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: stopping tablet replica
I20261115 14:58:27.662048 15018 raft_consensus.cc:2261] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 1 LEADER]: Raft consensus shutting down.
W20261115 14:58:27.662220 14685 catalog_manager.cc:5045] TS cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969): delete failed for tablet 64c4ccc8a0dd4e56846f380b81957b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c4ccc8a0dd4e56846f380b81957b61 already in progress: copying tablet
I20261115 14:58:27.662549 15017 raft_consensus.cc:2261] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:27.663175 15018 raft_consensus.cc:2290] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:27.663148 15017 raft_consensus.cc:2290] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:27.667037 15017 ts_tablet_manager.cc:1962] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261115 14:58:27.667351 15018 ts_tablet_manager.cc:1962] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261115 14:58:27.670692 15014 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:27.671394 15014 tablet_bootstrap.cc:492] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Bootstrap complete.
I20261115 14:58:27.671926 15014 ts_tablet_manager.cc:1449] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20261115 14:58:27.674115 15014 raft_consensus.cc:360] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.674634 15014 raft_consensus.cc:748] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc58c59798d94b78aab389bded74e5da, State: Initialized, Role: FOLLOWER
I20261115 14:58:27.675313 15014 consensus_queue.cc:261] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f564cfdfb7214d56ae476a6a9b0ddded" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 39265 } } peers { permanent_uuid: "ea7a12a8ea454bb8bb35a9ae0f10e628" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 34517 } } peers { permanent_uuid: "cc58c59798d94b78aab389bded74e5da" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 35969 } }
I20261115 14:58:27.677114 15014 ts_tablet_manager.cc:1480] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20261115 14:58:27.677390 15014 ts_tablet_manager.cc:1503] Injecting 50ms of latency into OpenTablet
I20261115 14:58:27.681937 14794 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-15 14:58:27 UTC) from {username='slave'} at 127.0.0.1:41548
I20261115 14:58:27.682716 15017 ts_tablet_manager.cc:1975] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261115 14:58:27.683023 15018 ts_tablet_manager.cc:1975] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261115 14:58:27.683146 15017 log.cc:1199] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-1-root/wals/64c4ccc8a0dd4e56846f380b81957b61
W20261115 14:58:27.683470 14685 catalog_manager.cc:5045] TS cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969): delete failed for tablet 64c4ccc8a0dd4e56846f380b81957b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c4ccc8a0dd4e56846f380b81957b61 already in progress: copying tablet
I20261115 14:58:27.683492 15018 log.cc:1199] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-2-root/wals/64c4ccc8a0dd4e56846f380b81957b61
I20261115 14:58:27.684201 15017 ts_tablet_manager.cc:1996] T 64c4ccc8a0dd4e56846f380b81957b61 P f564cfdfb7214d56ae476a6a9b0ddded: Deleting consensus metadata
I20261115 14:58:27.684631 15018 ts_tablet_manager.cc:1996] T 64c4ccc8a0dd4e56846f380b81957b61 P ea7a12a8ea454bb8bb35a9ae0f10e628: Deleting consensus metadata
I20261115 14:58:27.686084 14687 catalog_manager.cc:5065] TS ea7a12a8ea454bb8bb35a9ae0f10e628 (127.12.1.3:34517): tablet 64c4ccc8a0dd4e56846f380b81957b61 (table test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]) successfully deleted
I20261115 14:58:27.687021 14686 catalog_manager.cc:5065] TS f564cfdfb7214d56ae476a6a9b0ddded (127.12.1.2:39265): tablet 64c4ccc8a0dd4e56846f380b81957b61 (table test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]) successfully deleted
I20261115 14:58:27.729578 14963 tablet_copy_service.cc:342] P ea7a12a8ea454bb8bb35a9ae0f10e628: Request end of tablet copy session cc58c59798d94b78aab389bded74e5da-64c4ccc8a0dd4e56846f380b81957b61 received from {username='slave'} at 127.0.0.1:59388
I20261115 14:58:27.730036 14963 tablet_copy_service.cc:434] P ea7a12a8ea454bb8bb35a9ae0f10e628: ending tablet copy session cc58c59798d94b78aab389bded74e5da-64c4ccc8a0dd4e56846f380b81957b61 on tablet 64c4ccc8a0dd4e56846f380b81957b61 with peer cc58c59798d94b78aab389bded74e5da
I20261115 14:58:27.734201 14794 tablet_service.cc:1547] Processing DeleteTablet for tablet 64c4ccc8a0dd4e56846f380b81957b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-15 14:58:27 UTC) from {username='slave'} at 127.0.0.1:41548
I20261115 14:58:27.734887 15013 tablet_replica.cc:333] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: stopping tablet replica
I20261115 14:58:27.735451 15013 raft_consensus.cc:2261] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:27.735873 15013 raft_consensus.cc:2290] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:27.737995 15013 ts_tablet_manager.cc:1962] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261115 14:58:27.748404 15013 ts_tablet_manager.cc:1975] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261115 14:58:27.748731 15013 log.cc:1199] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1794754656521719-12292-0/minicluster-data/ts-0-root/wals/64c4ccc8a0dd4e56846f380b81957b61
I20261115 14:58:27.749373 15013 ts_tablet_manager.cc:1996] T 64c4ccc8a0dd4e56846f380b81957b61 P cc58c59798d94b78aab389bded74e5da: Deleting consensus metadata
I20261115 14:58:27.751619 14685 catalog_manager.cc:5065] TS cc58c59798d94b78aab389bded74e5da (127.12.1.1:35969): tablet 64c4ccc8a0dd4e56846f380b81957b61 (table test-table [id=72648f1dae2f4da58e2c3cb02bbf8b03]) successfully deleted
I20261115 14:58:27.793533 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:27.816514 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:27.834674 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:27.845440 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:58:27.865617 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:27.882385 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:27.890930 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
I20261115 14:58:27.909920 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:27.927387 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:58:27.935875 12292 master.cc:585] Master@127.12.1.62:33259 shutting down...
I20261115 14:58:27.956377 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:27.956918 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:27.957269 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P d52a0acf7b914e09970438b2add8074e: stopping tablet replica
I20261115 14:58:27.975317 12292 master.cc:607] Master@127.12.1.62:33259 shutdown complete.
[       OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1259 ms)
[----------] 4 tests from TsTabletManagerITest (45805 ms total)

[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN      ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20261115 14:58:28.006804 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:43871
I20261115 14:58:28.007977 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:28.012948 15024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.014127 15025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.015751 15027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.017390 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:28.018281 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:28.018513 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:28.018678 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754708018664 us; error 0 us; skew 500 ppm
I20261115 14:58:28.019261 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:28.021696 12292 webserver.cc:577] Webserver started at http://127.12.1.62:44771/ using document root <none> and password file <none>
I20261115 14:58:28.022192 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:28.022392 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:28.022665 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:28.023742 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "d7b358e07758433aa4a20bbdfa577bdd"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.028371 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:28.031704 15032 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.032531 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:28.032825 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "d7b358e07758433aa4a20bbdfa577bdd"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.033094 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:28.049418 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:28.050652 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:28.087375 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:43871
I20261115 14:58:28.087469 15083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:43871 every 8 connection(s)
I20261115 14:58:28.091621 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:28.102625 15084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd: Bootstrap starting.
I20261115 14:58:28.107614 15084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:28.111747 15084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd: No bootstrap required, opened a new log
I20261115 14:58:28.113765 15084 raft_consensus.cc:360] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER }
I20261115 14:58:28.114116 15084 raft_consensus.cc:386] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:28.114287 15084 raft_consensus.cc:748] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b358e07758433aa4a20bbdfa577bdd, State: Initialized, Role: FOLLOWER
I20261115 14:58:28.114760 15084 consensus_queue.cc:261] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER }
I20261115 14:58:28.115139 15084 raft_consensus.cc:400] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:28.115321 15084 raft_consensus.cc:499] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:28.115513 15084 raft_consensus.cc:3096] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:28.119654 15084 raft_consensus.cc:521] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER }
I20261115 14:58:28.120136 15084 leader_election.cc:304] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7b358e07758433aa4a20bbdfa577bdd; no voters: 
I20261115 14:58:28.121168 15084 leader_election.cc:290] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:28.121481 15087 raft_consensus.cc:2826] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:28.122777 15087 raft_consensus.cc:705] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 1 LEADER]: Becoming Leader. State: Replica: d7b358e07758433aa4a20bbdfa577bdd, State: Running, Role: LEADER
I20261115 14:58:28.123447 15087 consensus_queue.cc:238] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER }
I20261115 14:58:28.124143 15084 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:28.126426 15088 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7b358e07758433aa4a20bbdfa577bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER } }
I20261115 14:58:28.126626 15089 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7b358e07758433aa4a20bbdfa577bdd. Latest consensus state: current_term: 1 leader_uuid: "d7b358e07758433aa4a20bbdfa577bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b358e07758433aa4a20bbdfa577bdd" member_type: VOTER } }
I20261115 14:58:28.127068 15088 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:28.127151 15089 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:28.138278 15093 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:28.143934 15093 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:28.145044 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:28.152890 15093 catalog_manager.cc:1398] Generated new cluster ID: 98fe5a8f03814213ad09a3c12666d7d8
I20261115 14:58:28.153138 15093 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:28.164664 15093 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:28.165917 15093 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:28.182313 15093 catalog_manager.cc:6221] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd: Generated new TSK 0
I20261115 14:58:28.182971 15093 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:28.212262 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:28.218290 15105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.219291 15106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.221272 15108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.221630 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:28.222447 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:28.222678 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:28.222841 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754708222823 us; error 0 us; skew 500 ppm
I20261115 14:58:28.223389 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:28.225660 12292 webserver.cc:577] Webserver started at http://127.12.1.1:37809/ using document root <none> and password file <none>
I20261115 14:58:28.226217 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:28.226423 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:28.226691 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:28.227744 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "d271256577fb48afa5c374a32388df99"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.232254 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:28.235572 15113 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.236358 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:28.236645 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "d271256577fb48afa5c374a32388df99"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.236930 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:28.247186 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:28.248350 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:28.254413 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:28.254732 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.254980 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:28.255152 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.302577 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:33015
I20261115 14:58:28.302668 15183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:33015 every 8 connection(s)
I20261115 14:58:28.307744 15184 heartbeater.cc:345] Connected to a master server at 127.12.1.62:43871
I20261115 14:58:28.308144 15184 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:28.308940 15184 heartbeater.cc:508] Master 127.12.1.62:43871 requested a full tablet report, sending...
I20261115 14:58:28.310901 15049 ts_manager.cc:210] Registered new tserver with Master: d271256577fb48afa5c374a32388df99 (127.12.1.1:33015)
I20261115 14:58:28.311048 12292 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004840109s
I20261115 14:58:28.312708 15049 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36940
I20261115 14:58:28.342263 15149 tablet_service.cc:1500] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20261115 14:58:28.343509 15149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:28.354873 15194 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Bootstrap starting.
I20261115 14:58:28.359619 15194 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:28.363741 15194 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: No bootstrap required, opened a new log
I20261115 14:58:28.364147 15194 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20261115 14:58:28.366063 15194 raft_consensus.cc:360] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.366451 15194 raft_consensus.cc:386] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:28.366684 15194 raft_consensus.cc:748] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d271256577fb48afa5c374a32388df99, State: Initialized, Role: FOLLOWER
I20261115 14:58:28.367204 15194 consensus_queue.cc:261] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.367655 15194 raft_consensus.cc:400] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:28.367885 15194 raft_consensus.cc:499] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:28.368178 15194 raft_consensus.cc:3096] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:28.372689 15194 raft_consensus.cc:521] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.373204 15194 leader_election.cc:304] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d271256577fb48afa5c374a32388df99; no voters: 
I20261115 14:58:28.374316 15194 leader_election.cc:290] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:28.374646 15196 raft_consensus.cc:2826] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:28.375964 15196 raft_consensus.cc:705] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 LEADER]: Becoming Leader. State: Replica: d271256577fb48afa5c374a32388df99, State: Running, Role: LEADER
I20261115 14:58:28.376266 15184 heartbeater.cc:500] Master 127.12.1.62:43871 was elected leader, sending a full tablet report...
I20261115 14:58:28.376720 15194 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.004s
I20261115 14:58:28.376822 15196 consensus_queue.cc:238] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.381031 15198 tablet_replica.cc:442] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: TxnStatusTablet state changed. Reason: New leader d271256577fb48afa5c374a32388df99. Latest consensus state: current_term: 1 leader_uuid: "d271256577fb48afa5c374a32388df99" committed_config { opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } } }
I20261115 14:58:28.381788 15198 tablet_replica.cc:445] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:28.382102 15197 tablet_replica.cc:442] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d271256577fb48afa5c374a32388df99" committed_config { opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } } }
I20261115 14:58:28.382913 15197 tablet_replica.cc:445] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: This TxnStatusTablet replica's current role is: LEADER
W20261115 14:58:28.385135 15049 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:28.386157 15201 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20261115 14:58:28.386689 15201 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20261115 14:58:28.389820 15049 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:28.420192 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:28.443835 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:28.444854 12292 tablet_replica.cc:333] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: stopping tablet replica
I20261115 14:58:28.445402 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:28.445895 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:28.457537 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:28.468972 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:28.474838 15204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.476716 15205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.478039 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:28.478475 15207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.479658 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:28.479941 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:28.480175 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754708480156 us; error 0 us; skew 500 ppm
I20261115 14:58:28.480909 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:28.483639 12292 webserver.cc:577] Webserver started at http://127.12.1.1:37809/ using document root <none> and password file <none>
I20261115 14:58:28.484308 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:28.484542 12292 fs_manager.cc:365] Using existing metadata directory in first data directory
I20261115 14:58:28.489439 12292 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20261115 14:58:28.493062 15212 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.493938 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20261115 14:58:28.494288 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "d271256577fb48afa5c374a32388df99"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.494669 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:28.512684 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:28.514050 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:28.522601 15221 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261115 14:58:28.530804 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261115 14:58:28.531198 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.010s	user 0.001s	sys 0.001s
I20261115 14:58:28.531605 12292 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261115 14:58:28.537603 15221 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Bootstrap starting.
I20261115 14:58:28.541536 12292 ts_tablet_manager.cc:662] Registered 1 tablets
I20261115 14:58:28.541975 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.010s	user 0.006s	sys 0.000s
I20261115 14:58:28.581398 15221 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:28.582801 15221 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Bootstrap complete.
I20261115 14:58:28.583799 15221 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Time spent bootstrapping tablet: real 0.046s	user 0.031s	sys 0.012s
I20261115 14:58:28.587409 15221 raft_consensus.cc:360] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.588231 15221 raft_consensus.cc:748] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d271256577fb48afa5c374a32388df99, State: Initialized, Role: FOLLOWER
I20261115 14:58:28.589298 15221 consensus_queue.cc:261] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.590193 15221 raft_consensus.cc:400] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:28.590638 15221 raft_consensus.cc:499] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:28.591039 15221 raft_consensus.cc:3096] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:58:28.600044 15221 raft_consensus.cc:521] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.601145 15221 leader_election.cc:304] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d271256577fb48afa5c374a32388df99; no voters: 
I20261115 14:58:28.602908 15221 leader_election.cc:290] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20261115 14:58:28.603194 15275 raft_consensus.cc:2826] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:58:28.609824 15221 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.008s
I20261115 14:58:28.611002 15275 raft_consensus.cc:705] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 2 LEADER]: Becoming Leader. State: Replica: d271256577fb48afa5c374a32388df99, State: Running, Role: LEADER
I20261115 14:58:28.613492 15275 consensus_queue.cc:238] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } }
I20261115 14:58:28.617945 15278 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader d271256577fb48afa5c374a32388df99. Latest consensus state: current_term: 2 leader_uuid: "d271256577fb48afa5c374a32388df99" committed_config { opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } } }
I20261115 14:58:28.618542 15278 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:28.619992 15286 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20261115 14:58:28.619992 15277 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d271256577fb48afa5c374a32388df99" committed_config { opid_index: -1 peers { permanent_uuid: "d271256577fb48afa5c374a32388df99" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33015 } } }
I20261115 14:58:28.620672 15277 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:28.620684 15286 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20261115 14:58:28.637553 15289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:33015 every 8 connection(s)
I20261115 14:58:28.638129 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:33015
I20261115 14:58:28.645917 15290 heartbeater.cc:345] Connected to a master server at 127.12.1.62:43871
I20261115 14:58:28.646905 12292 tablet_server.cc:179] TabletServer@127.12.1.1:33015 shutting down...
I20261115 14:58:28.647056 15290 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:28.649762 15290 heartbeater.cc:508] Master 127.12.1.62:43871 requested a full tablet report, sending...
I20261115 14:58:28.653352 15049 ts_manager.cc:210] Re-registered known tserver with Master: d271256577fb48afa5c374a32388df99 (127.12.1.1:33015)
W20261115 14:58:28.654058 15049 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:28.655797 15049 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36954
I20261115 14:58:28.659399 15290 heartbeater.cc:500] Master 127.12.1.62:43871 was elected leader, sending a full tablet report...
W20261115 14:58:28.666742 15049 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:28.671821 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:28.672652 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:28.673262 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 2 LEADER]: Raft consensus shutting down.
I20261115 14:58:28.673713 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P d271256577fb48afa5c374a32388df99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:28.685889 12292 tablet_server.cc:196] TabletServer@127.12.1.1:33015 shutdown complete.
I20261115 14:58:28.696400 12292 master.cc:585] Master@127.12.1.62:43871 shutting down...
I20261115 14:58:28.719547 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:28.720155 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:28.720471 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P d7b358e07758433aa4a20bbdfa577bdd: stopping tablet replica
I20261115 14:58:28.739125 12292 master.cc:607] Master@127.12.1.62:43871 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (763 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20261115 14:58:28.772926 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:39573
I20261115 14:58:28.774351 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:28.780504 15296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:28.781744 15297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.784523 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:28.785187 15299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:28.786006 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:28.786234 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:28.786406 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754708786387 us; error 0 us; skew 500 ppm
I20261115 14:58:28.786949 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:28.789460 12292 webserver.cc:577] Webserver started at http://127.12.1.62:41723/ using document root <none> and password file <none>
I20261115 14:58:28.789945 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:28.790145 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:28.790411 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:28.791497 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "db94241f057047ebaf5154b87ac29687"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.796412 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20261115 14:58:28.799932 15304 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:28.800797 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261115 14:58:28.801162 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "db94241f057047ebaf5154b87ac29687"
format_stamp: "Formatted at 2026-11-15 14:58:28 on dist-test-slave-fhcn"
I20261115 14:58:28.801457 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:28.825670 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:28.826725 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:28.875315 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:39573
I20261115 14:58:28.875418 15355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:39573 every 8 connection(s)
I20261115 14:58:28.879675 15356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:28.889452 15356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687: Bootstrap starting.
I20261115 14:58:28.893860 15356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:28.897979 15356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687: No bootstrap required, opened a new log
I20261115 14:58:28.900044 15356 raft_consensus.cc:360] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER }
I20261115 14:58:28.900511 15356 raft_consensus.cc:386] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:28.900715 15356 raft_consensus.cc:748] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db94241f057047ebaf5154b87ac29687, State: Initialized, Role: FOLLOWER
I20261115 14:58:28.901362 15356 consensus_queue.cc:261] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER }
I20261115 14:58:28.901795 15356 raft_consensus.cc:400] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:28.902036 15356 raft_consensus.cc:499] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:28.902292 15356 raft_consensus.cc:3096] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:28.907481 15356 raft_consensus.cc:521] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER }
I20261115 14:58:28.907976 15356 leader_election.cc:304] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db94241f057047ebaf5154b87ac29687; no voters: 
I20261115 14:58:28.909209 15356 leader_election.cc:290] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:28.909559 15359 raft_consensus.cc:2826] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:28.911175 15359 raft_consensus.cc:705] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 1 LEADER]: Becoming Leader. State: Replica: db94241f057047ebaf5154b87ac29687, State: Running, Role: LEADER
I20261115 14:58:28.912253 15356 sys_catalog.cc:565] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:28.911957 15359 consensus_queue.cc:238] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER }
I20261115 14:58:28.915081 15360 sys_catalog.cc:455] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db94241f057047ebaf5154b87ac29687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER } }
I20261115 14:58:28.915627 15360 sys_catalog.cc:458] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:28.916667 15361 sys_catalog.cc:455] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db94241f057047ebaf5154b87ac29687. Latest consensus state: current_term: 1 leader_uuid: "db94241f057047ebaf5154b87ac29687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db94241f057047ebaf5154b87ac29687" member_type: VOTER } }
I20261115 14:58:28.917163 15361 sys_catalog.cc:458] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:28.922070 15364 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:28.928838 15364 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:28.930001 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:28.938814 15364 catalog_manager.cc:1398] Generated new cluster ID: fef5fd2319b545cc9e56029f1a13c7f4
I20261115 14:58:28.939170 15364 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:28.970008 15364 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:28.971684 15364 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:28.986469 15364 catalog_manager.cc:6221] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687: Generated new TSK 0
I20261115 14:58:28.987118 15364 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:28.996534 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:29.003750 15377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.004889 15378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.008055 15381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:29.008340 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:29.009282 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:29.009496 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:29.009667 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754709009649 us; error 0 us; skew 500 ppm
I20261115 14:58:29.010207 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:29.013151 12292 webserver.cc:577] Webserver started at http://127.12.1.1:44815/ using document root <none> and password file <none>
I20261115 14:58:29.013718 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:29.014135 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:29.014408 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:29.015482 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0"
format_stamp: "Formatted at 2026-11-15 14:58:29 on dist-test-slave-fhcn"
I20261115 14:58:29.020521 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:58:29.024221 15385 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.025067 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20261115 14:58:29.025372 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0"
format_stamp: "Formatted at 2026-11-15 14:58:29 on dist-test-slave-fhcn"
I20261115 14:58:29.025642 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:29.063273 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:29.064391 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:29.083313 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:29.083581 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.083856 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:29.084036 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.151528 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:38825
I20261115 14:58:29.151665 15455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:38825 every 8 connection(s)
I20261115 14:58:29.156831 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261115 14:58:29.157296 15456 heartbeater.cc:345] Connected to a master server at 127.12.1.62:39573
I20261115 14:58:29.157696 15456 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:29.158545 15456 heartbeater.cc:508] Master 127.12.1.62:39573 requested a full tablet report, sending...
I20261115 14:58:29.160838 15321 ts_manager.cc:210] Registered new tserver with Master: 73f5118fad9c47c6ac1f2a0ac406d8b0 (127.12.1.1:38825)
I20261115 14:58:29.163216 15321 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49362
W20261115 14:58:29.163995 15458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.168913 15459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.171078 15461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:29.171280 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:29.172119 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:29.172328 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:29.172519 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754709172488 us; error 0 us; skew 500 ppm
I20261115 14:58:29.173060 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:29.175788 12292 webserver.cc:577] Webserver started at http://127.12.1.2:40799/ using document root <none> and password file <none>
I20261115 14:58:29.176316 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:29.176501 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:29.176775 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:29.177845 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "9d51049154794c569c895bad1380c104"
format_stamp: "Formatted at 2026-11-15 14:58:29 on dist-test-slave-fhcn"
I20261115 14:58:29.182605 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:58:29.186113 15466 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.186950 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:58:29.187240 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "9d51049154794c569c895bad1380c104"
format_stamp: "Formatted at 2026-11-15 14:58:29 on dist-test-slave-fhcn"
I20261115 14:58:29.187500 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:29.215597 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:29.216707 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:29.223412 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:29.223790 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20261115 14:58:29.224171 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:29.224355 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.283612 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:33527
I20261115 14:58:29.283692 15535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:33527 every 8 connection(s)
I20261115 14:58:29.289736 15536 heartbeater.cc:345] Connected to a master server at 127.12.1.62:39573
I20261115 14:58:29.290117 15536 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:29.290802 15536 heartbeater.cc:508] Master 127.12.1.62:39573 requested a full tablet report, sending...
I20261115 14:58:29.292737 15321 ts_manager.cc:210] Registered new tserver with Master: 9d51049154794c569c895bad1380c104 (127.12.1.2:33527)
I20261115 14:58:29.292943 12292 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.005080372s
I20261115 14:58:29.294112 15321 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49386
I20261115 14:58:29.328795 15421 tablet_service.cc:1500] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20261115 14:58:29.329970 15421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:29.341642 15546 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Bootstrap starting.
I20261115 14:58:29.346184 15546 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:29.350208 15546 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: No bootstrap required, opened a new log
I20261115 14:58:29.350605 15546 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Time spent bootstrapping tablet: real 0.009s	user 0.003s	sys 0.004s
I20261115 14:58:29.352643 15546 raft_consensus.cc:360] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.353055 15546 raft_consensus.cc:386] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:29.353303 15546 raft_consensus.cc:748] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f5118fad9c47c6ac1f2a0ac406d8b0, State: Initialized, Role: FOLLOWER
I20261115 14:58:29.353881 15546 consensus_queue.cc:261] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.354362 15546 raft_consensus.cc:400] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:29.354583 15546 raft_consensus.cc:499] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:29.354832 15546 raft_consensus.cc:3096] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:29.359128 15546 raft_consensus.cc:521] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.359634 15546 leader_election.cc:304] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73f5118fad9c47c6ac1f2a0ac406d8b0; no voters: 
I20261115 14:58:29.361019 15546 leader_election.cc:290] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:29.361387 15548 raft_consensus.cc:2826] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:29.362949 15456 heartbeater.cc:500] Master 127.12.1.62:39573 was elected leader, sending a full tablet report...
I20261115 14:58:29.363765 15546 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
I20261115 14:58:29.364159 15548 raft_consensus.cc:705] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 LEADER]: Becoming Leader. State: Replica: 73f5118fad9c47c6ac1f2a0ac406d8b0, State: Running, Role: LEADER
I20261115 14:58:29.364841 15548 consensus_queue.cc:238] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.368685 15549 tablet_replica.cc:442] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" committed_config { opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } } }
I20261115 14:58:29.369234 15549 tablet_replica.cc:445] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: This TxnStatusTablet replica's current role is: LEADER
W20261115 14:58:29.371263 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:29.371058 15550 tablet_replica.cc:442] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: TxnStatusTablet state changed. Reason: New leader 73f5118fad9c47c6ac1f2a0ac406d8b0. Latest consensus state: current_term: 1 leader_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" committed_config { opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } } }
I20261115 14:58:29.371933 15550 tablet_replica.cc:445] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:29.378952 15552 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
W20261115 14:58:29.379117 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:29.379384 15552 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20261115 14:58:29.434558 15557 ts_tablet_manager.cc:979] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Initiating tablet copy from peer 73f5118fad9c47c6ac1f2a0ac406d8b0 (127.12.1.1:38825)
I20261115 14:58:29.436147 15557 tablet_copy_client.cc:323] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.1:38825
I20261115 14:58:29.444695 15441 tablet_copy_service.cc:140] P 73f5118fad9c47c6ac1f2a0ac406d8b0: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer 9d51049154794c569c895bad1380c104 ({username='slave'} at 127.0.0.1:49462)
I20261115 14:58:29.445168 15441 tablet_copy_service.cc:161] P 73f5118fad9c47c6ac1f2a0ac406d8b0: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer 9d51049154794c569c895bad1380c104 at {username='slave'} at 127.0.0.1:49462: session id = 9d51049154794c569c895bad1380c104-11111111111111111111111111111111
I20261115 14:58:29.450057 15441 tablet_copy_source_session.cc:215] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Tablet Copy: opened 0 blocks and 1 log segments
I20261115 14:58:29.452965 15557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:29.468994 15557 tablet_copy_client.cc:806] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: tablet copy: Starting download of 0 data blocks...
I20261115 14:58:29.469588 15557 tablet_copy_client.cc:670] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: tablet copy: Starting download of 1 WAL segments...
I20261115 14:58:29.473191 15557 tablet_copy_client.cc:538] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261115 14:58:29.479039 15557 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Bootstrap starting.
I20261115 14:58:29.503854 15557 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:29.504681 15557 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Bootstrap complete.
I20261115 14:58:29.505317 15557 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.004s
I20261115 14:58:29.507510 15557 raft_consensus.cc:360] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.507978 15557 raft_consensus.cc:748] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 9d51049154794c569c895bad1380c104, State: Initialized, Role: NON_PARTICIPANT
I20261115 14:58:29.508523 15557 consensus_queue.cc:261] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.510247 15560 tablet_replica.cc:442] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } } }
I20261115 14:58:29.510437 15536 heartbeater.cc:500] Master 127.12.1.62:39573 was elected leader, sending a full tablet report...
I20261115 14:58:29.510820 15560 tablet_replica.cc:445] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20261115 14:58:29.510924 15557 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20261115 14:58:29.512880 15441 tablet_copy_service.cc:342] P 73f5118fad9c47c6ac1f2a0ac406d8b0: Request end of tablet copy session 9d51049154794c569c895bad1380c104-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:49462
I20261115 14:58:29.513223 15441 tablet_copy_service.cc:434] P 73f5118fad9c47c6ac1f2a0ac406d8b0: ending tablet copy session 9d51049154794c569c895bad1380c104-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer 9d51049154794c569c895bad1380c104
W20261115 14:58:29.513677 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
W20261115 14:58:29.517858 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:29.534164 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:29.558020 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:29.558925 12292 tablet_replica.cc:333] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: stopping tablet replica
I20261115 14:58:29.559571 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:29.560189 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:29.572849 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:29.594307 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:29.601699 15561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.603708 15562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:29.606623 15564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:29.607462 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:29.608815 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:29.609088 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:29.609282 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754709609264 us; error 0 us; skew 500 ppm
I20261115 14:58:29.609990 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:29.612831 12292 webserver.cc:577] Webserver started at http://127.12.1.1:44815/ using document root <none> and password file <none>
I20261115 14:58:29.613441 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:29.613860 12292 fs_manager.cc:365] Using existing metadata directory in first data directory
I20261115 14:58:29.618759 12292 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:29.622684 15569 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:29.623643 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261115 14:58:29.624127 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0"
format_stamp: "Formatted at 2026-11-15 14:58:29 on dist-test-slave-fhcn"
I20261115 14:58:29.624572 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:29.658648 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:29.660152 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:29.668556 15578 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261115 14:58:29.676139 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261115 14:58:29.676463 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.009s	user 0.000s	sys 0.001s
I20261115 14:58:29.676786 12292 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261115 14:58:29.683795 12292 ts_tablet_manager.cc:662] Registered 1 tablets
I20261115 14:58:29.684096 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.007s	user 0.004s	sys 0.000s
I20261115 14:58:29.685765 15578 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Bootstrap starting.
I20261115 14:58:29.732105 15578 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:29.733340 15578 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Bootstrap complete.
I20261115 14:58:29.734253 15578 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Time spent bootstrapping tablet: real 0.049s	user 0.033s	sys 0.011s
I20261115 14:58:29.737582 15578 raft_consensus.cc:360] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.738543 15578 raft_consensus.cc:748] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f5118fad9c47c6ac1f2a0ac406d8b0, State: Initialized, Role: FOLLOWER
I20261115 14:58:29.739530 15578 consensus_queue.cc:261] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.740322 15578 raft_consensus.cc:400] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:29.740721 15578 raft_consensus.cc:499] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:29.741102 15578 raft_consensus.cc:3096] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 1 FOLLOWER]: Advancing to term 2
I20261115 14:58:29.750313 15578 raft_consensus.cc:521] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.751192 15578 leader_election.cc:304] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73f5118fad9c47c6ac1f2a0ac406d8b0; no voters: 
I20261115 14:58:29.753101 15578 leader_election.cc:290] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20261115 14:58:29.753381 15620 raft_consensus.cc:2826] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 2 FOLLOWER]: Leader election won for term 2
I20261115 14:58:29.768610 15620 raft_consensus.cc:705] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 2 LEADER]: Becoming Leader. State: Replica: 73f5118fad9c47c6ac1f2a0ac406d8b0, State: Running, Role: LEADER
I20261115 14:58:29.769588 15620 consensus_queue.cc:238] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } }
I20261115 14:58:29.771354 15578 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0: Time spent starting tablet: real 0.037s	user 0.015s	sys 0.019s
I20261115 14:58:29.776062 15623 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" committed_config { opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } } }
I20261115 14:58:29.776304 15622 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 73f5118fad9c47c6ac1f2a0ac406d8b0. Latest consensus state: current_term: 2 leader_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" committed_config { opid_index: -1 peers { permanent_uuid: "73f5118fad9c47c6ac1f2a0ac406d8b0" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 38825 } } }
I20261115 14:58:29.776805 15623 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:29.776885 15622 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:29.780483 15629 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20261115 14:58:29.780962 15629 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20261115 14:58:29.803141 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:38825
I20261115 14:58:29.803170 15646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:38825 every 8 connection(s)
I20261115 14:58:29.811074 15647 heartbeater.cc:345] Connected to a master server at 127.12.1.62:39573
I20261115 14:58:29.817628 15647 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:29.818957 12292 tablet_server.cc:179] TabletServer@127.12.1.1:38825 shutting down...
I20261115 14:58:29.821213 15647 heartbeater.cc:508] Master 127.12.1.62:39573 requested a full tablet report, sending...
I20261115 14:58:29.825531 15321 ts_manager.cc:210] Re-registered known tserver with Master: 73f5118fad9c47c6ac1f2a0ac406d8b0 (127.12.1.1:38825)
W20261115 14:58:29.826020 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:29.827288 15321 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49416
I20261115 14:58:29.830101 15647 heartbeater.cc:500] Master 127.12.1.62:39573 was elected leader, sending a full tablet report...
W20261115 14:58:29.835229 15321 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:29.858500 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:29.859450 12292 tablet_replica.cc:333] stopping tablet replica
I20261115 14:58:29.860195 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 2 LEADER]: Raft consensus shutting down.
I20261115 14:58:29.860769 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P 73f5118fad9c47c6ac1f2a0ac406d8b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:29.873350 12292 tablet_server.cc:196] TabletServer@127.12.1.1:38825 shutdown complete.
I20261115 14:58:29.884855 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:58:29.911365 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:29.912309 12292 tablet_replica.cc:333] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104: stopping tablet replica
I20261115 14:58:29.912961 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20261115 14:58:29.913421 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P 9d51049154794c569c895bad1380c104 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20261115 14:58:29.924096 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:29.939162 12292 master.cc:585] Master@127.12.1.62:39573 shutting down...
I20261115 14:58:29.956935 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:29.957473 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:29.957791 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P db94241f057047ebaf5154b87ac29687: stopping tablet replica
I20261115 14:58:29.976280 12292 master.cc:607] Master@127.12.1.62:39573 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1231 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20261115 14:58:30.002629 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:40097
I20261115 14:58:30.003798 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:30.009059 15653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:30.010557 15654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:30.011855 15656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:30.017818 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:30.018658 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:30.018867 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:30.019034 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754710019017 us; error 0 us; skew 500 ppm
I20261115 14:58:30.019558 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:30.022352 12292 webserver.cc:577] Webserver started at http://127.12.1.62:45781/ using document root <none> and password file <none>
I20261115 14:58:30.022823 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:30.023023 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:30.023285 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:30.024439 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "e021717709f441af9e8553f3c018804d"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.029078 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:30.032634 15661 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:30.033478 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20261115 14:58:30.033819 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "e021717709f441af9e8553f3c018804d"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.034169 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:30.065750 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:30.067108 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:30.115115 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:40097
I20261115 14:58:30.115258 15712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:40097 every 8 connection(s)
I20261115 14:58:30.119302 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:30.129341 15713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d: Bootstrap starting.
I20261115 14:58:30.133631 15713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:30.137836 15713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d: No bootstrap required, opened a new log
I20261115 14:58:30.139783 15713 raft_consensus.cc:360] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER }
I20261115 14:58:30.140223 15713 raft_consensus.cc:386] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:30.140432 15713 raft_consensus.cc:748] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e021717709f441af9e8553f3c018804d, State: Initialized, Role: FOLLOWER
I20261115 14:58:30.140996 15713 consensus_queue.cc:261] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER }
I20261115 14:58:30.141415 15713 raft_consensus.cc:400] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:30.141623 15713 raft_consensus.cc:499] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:30.141883 15713 raft_consensus.cc:3096] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:30.146401 15713 raft_consensus.cc:521] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER }
I20261115 14:58:30.146924 15713 leader_election.cc:304] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e021717709f441af9e8553f3c018804d; no voters: 
I20261115 14:58:30.148247 15713 leader_election.cc:290] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:30.148587 15716 raft_consensus.cc:2826] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:30.150270 15716 raft_consensus.cc:705] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 1 LEADER]: Becoming Leader. State: Replica: e021717709f441af9e8553f3c018804d, State: Running, Role: LEADER
I20261115 14:58:30.150981 15716 consensus_queue.cc:238] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER }
I20261115 14:58:30.151675 15713 sys_catalog.cc:565] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:30.154477 15718 sys_catalog.cc:455] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e021717709f441af9e8553f3c018804d. Latest consensus state: current_term: 1 leader_uuid: "e021717709f441af9e8553f3c018804d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER } }
I20261115 14:58:30.155025 15718 sys_catalog.cc:458] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:30.156543 15717 sys_catalog.cc:455] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e021717709f441af9e8553f3c018804d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e021717709f441af9e8553f3c018804d" member_type: VOTER } }
I20261115 14:58:30.157190 15717 sys_catalog.cc:458] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:30.164753 15721 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:30.171566 15721 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:30.175463 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:30.182224 15721 catalog_manager.cc:1398] Generated new cluster ID: f6d3a234172a4f16b70381cbb3e63ace
I20261115 14:58:30.182510 15721 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:30.197659 15721 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:30.198841 15721 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:30.212376 15721 catalog_manager.cc:6221] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d: Generated new TSK 0
I20261115 14:58:30.212970 15721 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:30.244324 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:30.250608 15734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:30.250967 15735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:30.254383 15738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:30.254586 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:30.255579 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:30.255798 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:30.255967 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754710255951 us; error 0 us; skew 500 ppm
I20261115 14:58:30.256554 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:30.259213 12292 webserver.cc:577] Webserver started at http://127.12.1.1:36977/ using document root <none> and password file <none>
I20261115 14:58:30.259685 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:30.259881 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:30.260213 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:30.261322 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "43cb3155ea204b7a8005f044ad8036ee"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.266043 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20261115 14:58:30.269559 15742 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:30.270548 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20261115 14:58:30.270900 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "43cb3155ea204b7a8005f044ad8036ee"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.271255 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:30.289076 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:30.290576 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:30.313791 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:30.314215 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20261115 14:58:30.314563 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:30.314785 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:30.378222 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:45351
I20261115 14:58:30.378288 15812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:45351 every 8 connection(s)
I20261115 14:58:30.384277 15813 heartbeater.cc:345] Connected to a master server at 127.12.1.62:40097
I20261115 14:58:30.384712 15813 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:30.385588 15813 heartbeater.cc:508] Master 127.12.1.62:40097 requested a full tablet report, sending...
I20261115 14:58:30.387723 15678 ts_manager.cc:210] Registered new tserver with Master: 43cb3155ea204b7a8005f044ad8036ee (127.12.1.1:45351)
I20261115 14:58:30.388418 12292 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005993053s
I20261115 14:58:30.389518 15678 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42862
I20261115 14:58:30.424131 15778 tablet_service.cc:1500] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20261115 14:58:30.425628 15778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:30.442051 15823 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: Bootstrap starting.
I20261115 14:58:30.446604 15823 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:30.450707 15823 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: No bootstrap required, opened a new log
I20261115 14:58:30.451124 15823 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20261115 14:58:30.453120 15823 raft_consensus.cc:360] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } }
I20261115 14:58:30.453677 15823 raft_consensus.cc:386] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:30.453961 15823 raft_consensus.cc:748] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43cb3155ea204b7a8005f044ad8036ee, State: Initialized, Role: FOLLOWER
I20261115 14:58:30.454599 15823 consensus_queue.cc:261] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } }
I20261115 14:58:30.455066 15823 raft_consensus.cc:400] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:30.455278 15823 raft_consensus.cc:499] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:30.455552 15823 raft_consensus.cc:3096] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:30.460036 15823 raft_consensus.cc:521] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } }
I20261115 14:58:30.460641 15823 leader_election.cc:304] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43cb3155ea204b7a8005f044ad8036ee; no voters: 
I20261115 14:58:30.462014 15823 leader_election.cc:290] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:30.462375 15825 raft_consensus.cc:2826] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:30.463876 15813 heartbeater.cc:500] Master 127.12.1.62:40097 was elected leader, sending a full tablet report...
I20261115 14:58:30.464557 15823 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: Time spent starting tablet: real 0.013s	user 0.015s	sys 0.000s
I20261115 14:58:30.464676 15825 raft_consensus.cc:705] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 1 LEADER]: Becoming Leader. State: Replica: 43cb3155ea204b7a8005f044ad8036ee, State: Running, Role: LEADER
I20261115 14:58:30.465377 15825 consensus_queue.cc:238] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } }
I20261115 14:58:30.468112 15826 tablet_replica.cc:442] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43cb3155ea204b7a8005f044ad8036ee" committed_config { opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } } }
I20261115 14:58:30.468609 15827 tablet_replica.cc:442] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: TxnStatusTablet state changed. Reason: New leader 43cb3155ea204b7a8005f044ad8036ee. Latest consensus state: current_term: 1 leader_uuid: "43cb3155ea204b7a8005f044ad8036ee" committed_config { opid_index: -1 peers { permanent_uuid: "43cb3155ea204b7a8005f044ad8036ee" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 45351 } } }
I20261115 14:58:30.469120 15827 tablet_replica.cc:445] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: This TxnStatusTablet replica's current role is: LEADER
W20261115 14:58:30.472541 15678 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:30.468629 15826 tablet_replica.cc:445] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:30.478235 15829 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20261115 14:58:30.478713 15829 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20261115 14:58:30.480854 15678 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
W20261115 14:58:30.531112 15754 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20261115 14:58:30.531476 15754 txn_status_manager.cc:244] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20261115 14:58:30.531881 15754 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20261115 14:58:30.540340 15754 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20261115 14:58:30.578716 15754 txn_status_manager.cc:244] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20261115 14:58:30.579044 15754 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20261115 14:58:30.587299 15754 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20261115 14:58:30.598496 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.601296 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.603440 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.605584 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.607733 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.609814 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:39488
W20261115 14:58:30.620265 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
W20261115 14:58:30.622723 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
W20261115 14:58:30.625185 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
W20261115 14:58:30.627303 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
W20261115 14:58:30.629390 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
W20261115 14:58:30.631386 15777 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:39504
I20261115 14:58:30.635842 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:30.668486 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:30.669546 12292 tablet_replica.cc:333] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee: stopping tablet replica
I20261115 14:58:30.670225 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:30.670819 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P 43cb3155ea204b7a8005f044ad8036ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:30.694000 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:30.707798 12292 master.cc:585] Master@127.12.1.62:40097 shutting down...
I20261115 14:58:30.731495 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:30.732219 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:30.732640 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P e021717709f441af9e8553f3c018804d: stopping tablet replica
I20261115 14:58:30.752748 12292 master.cc:607] Master@127.12.1.62:40097 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (776 ms)
[ RUN      ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20261115 14:58:30.779325 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:36803
I20261115 14:58:30.780527 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:30.785897 15838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:30.786291 15839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:30.788988 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:30.789253 15842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:30.790177 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:30.790395 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:30.790572 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754710790553 us; error 0 us; skew 500 ppm
I20261115 14:58:30.791133 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:30.793660 12292 webserver.cc:577] Webserver started at http://127.12.1.62:37339/ using document root <none> and password file <none>
I20261115 14:58:30.794152 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:30.794484 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:30.794809 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:30.795949 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "e842442c080b4a7e9dd922d4ca4803ff"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.800791 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:30.804476 15846 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:30.805338 12292 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20261115 14:58:30.805645 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "e842442c080b4a7e9dd922d4ca4803ff"
format_stamp: "Formatted at 2026-11-15 14:58:30 on dist-test-slave-fhcn"
I20261115 14:58:30.805962 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:30.855376 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:30.856711 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:30.901742 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:36803
I20261115 14:58:30.901850 15897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:36803 every 8 connection(s)
I20261115 14:58:30.905529 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:30.915612 15898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff: Bootstrap starting.
I20261115 14:58:30.920696 15898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:30.924664 15898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff: No bootstrap required, opened a new log
I20261115 14:58:30.926667 15898 raft_consensus.cc:360] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER }
I20261115 14:58:30.927064 15898 raft_consensus.cc:386] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:30.927304 15898 raft_consensus.cc:748] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e842442c080b4a7e9dd922d4ca4803ff, State: Initialized, Role: FOLLOWER
I20261115 14:58:30.927865 15898 consensus_queue.cc:261] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER }
I20261115 14:58:30.928325 15898 raft_consensus.cc:400] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:30.928560 15898 raft_consensus.cc:499] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:30.928819 15898 raft_consensus.cc:3096] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:30.933324 15898 raft_consensus.cc:521] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER }
I20261115 14:58:30.933831 15898 leader_election.cc:304] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e842442c080b4a7e9dd922d4ca4803ff; no voters: 
I20261115 14:58:30.934974 15898 leader_election.cc:290] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:30.935326 15901 raft_consensus.cc:2826] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:30.936666 15901 raft_consensus.cc:705] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 1 LEADER]: Becoming Leader. State: Replica: e842442c080b4a7e9dd922d4ca4803ff, State: Running, Role: LEADER
I20261115 14:58:30.937327 15901 consensus_queue.cc:238] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER }
I20261115 14:58:30.937842 15898 sys_catalog.cc:565] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:30.939540 15903 sys_catalog.cc:455] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader e842442c080b4a7e9dd922d4ca4803ff. Latest consensus state: current_term: 1 leader_uuid: "e842442c080b4a7e9dd922d4ca4803ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER } }
I20261115 14:58:30.939976 15903 sys_catalog.cc:458] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:30.940665 15902 sys_catalog.cc:455] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e842442c080b4a7e9dd922d4ca4803ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e842442c080b4a7e9dd922d4ca4803ff" member_type: VOTER } }
I20261115 14:58:30.941377 15902 sys_catalog.cc:458] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:30.944378 15905 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:30.952219 15905 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:30.953192 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:30.960791 15905 catalog_manager.cc:1398] Generated new cluster ID: ce90d3085db748658e72acfa8d0450e5
I20261115 14:58:30.961122 15905 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:30.984200 15905 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:30.985538 15905 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:31.001039 15905 catalog_manager.cc:6221] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff: Generated new TSK 0
I20261115 14:58:31.001677 15905 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:31.020344 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:31.025849 15919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.027030 15920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.028870 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:31.028998 15922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.029953 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:31.030174 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:31.030370 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754711030349 us; error 0 us; skew 500 ppm
I20261115 14:58:31.030932 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:31.033245 12292 webserver.cc:577] Webserver started at http://127.12.1.1:45985/ using document root <none> and password file <none>
I20261115 14:58:31.033767 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:31.033964 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:31.034233 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:31.035301 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "1db51c6148a143ceb5e9de6e049aa95f"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.039873 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:58:31.043121 15927 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.043857 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:31.044186 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "1db51c6148a143ceb5e9de6e049aa95f"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.044432 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:31.057482 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:31.058447 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:31.063026 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:31.063431 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.063817 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:31.064106 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.002s	sys 0.000s
I20261115 14:58:31.114283 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:34971
I20261115 14:58:31.114374 15997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:34971 every 8 connection(s)
I20261115 14:58:31.118902 15998 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36803
I20261115 14:58:31.119292 15998 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:31.120023 15998 heartbeater.cc:508] Master 127.12.1.62:36803 requested a full tablet report, sending...
I20261115 14:58:31.121937 15863 ts_manager.cc:210] Registered new tserver with Master: 1db51c6148a143ceb5e9de6e049aa95f (127.12.1.1:34971)
I20261115 14:58:31.122349 12292 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004871007s
I20261115 14:58:31.124215 15863 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52960
I20261115 14:58:31.153267 15963 tablet_service.cc:1500] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20261115 14:58:31.154438 15963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.165103 16008 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: Bootstrap starting.
I20261115 14:58:31.169507 16008 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.173393 16008 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: No bootstrap required, opened a new log
I20261115 14:58:31.173801 16008 ts_tablet_manager.cc:1449] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20261115 14:58:31.175804 16008 raft_consensus.cc:360] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.176273 16008 raft_consensus.cc:386] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.176512 16008 raft_consensus.cc:748] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db51c6148a143ceb5e9de6e049aa95f, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.177047 16008 consensus_queue.cc:261] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.177491 16008 raft_consensus.cc:400] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:31.177726 16008 raft_consensus.cc:499] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:31.177985 16008 raft_consensus.cc:3096] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:31.182387 16008 raft_consensus.cc:521] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.182921 16008 leader_election.cc:304] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1db51c6148a143ceb5e9de6e049aa95f; no voters: 
I20261115 14:58:31.184051 16008 leader_election.cc:290] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:31.184448 16010 raft_consensus.cc:2826] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:31.185763 16010 raft_consensus.cc:705] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 LEADER]: Becoming Leader. State: Replica: 1db51c6148a143ceb5e9de6e049aa95f, State: Running, Role: LEADER
I20261115 14:58:31.186003 15998 heartbeater.cc:500] Master 127.12.1.62:36803 was elected leader, sending a full tablet report...
I20261115 14:58:31.186545 16008 ts_tablet_manager.cc:1480] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.008s
I20261115 14:58:31.186551 16010 consensus_queue.cc:238] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.190662 16012 tablet_replica.cc:442] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: TxnStatusTablet state changed. Reason: New leader 1db51c6148a143ceb5e9de6e049aa95f. Latest consensus state: current_term: 1 leader_uuid: "1db51c6148a143ceb5e9de6e049aa95f" committed_config { opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } } }
I20261115 14:58:31.191243 16012 tablet_replica.cc:445] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:31.192318 16011 tablet_replica.cc:442] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1db51c6148a143ceb5e9de6e049aa95f" committed_config { opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } } }
I20261115 14:58:31.192844 16011 tablet_replica.cc:445] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: This TxnStatusTablet replica's current role is: LEADER
I20261115 14:58:31.194001 16015 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20261115 14:58:31.194411 16015 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20261115 14:58:31.195227 15863 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
W20261115 14:58:31.198963 15863 catalog_manager.cc:5673] Ignoring report from unknown tablet 11111111111111111111111111111111
I20261115 14:58:31.222308 15963 tablet_service.cc:1500] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20261115 14:58:31.223428 15963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.234272 16008 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: Bootstrap starting.
I20261115 14:58:31.238520 16008 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.242416 16008 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: No bootstrap required, opened a new log
I20261115 14:58:31.242846 16008 ts_tablet_manager.cc:1449] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20261115 14:58:31.244822 16008 raft_consensus.cc:360] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.245262 16008 raft_consensus.cc:386] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.245491 16008 raft_consensus.cc:748] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db51c6148a143ceb5e9de6e049aa95f, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.245997 16008 consensus_queue.cc:261] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.246454 16008 raft_consensus.cc:400] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:31.246698 16008 raft_consensus.cc:499] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:31.246954 16008 raft_consensus.cc:3096] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:31.251607 16008 raft_consensus.cc:521] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
I20261115 14:58:31.252242 16008 leader_election.cc:304] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1db51c6148a143ceb5e9de6e049aa95f; no voters: 
I20261115 14:58:31.252729 16008 leader_election.cc:290] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:31.252928 16012 raft_consensus.cc:2826] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:31.253408 16012 raft_consensus.cc:705] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 LEADER]: Becoming Leader. State: Replica: 1db51c6148a143ceb5e9de6e049aa95f, State: Running, Role: LEADER
I20261115 14:58:31.254195 16008 ts_tablet_manager.cc:1480] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20261115 14:58:31.254081 16012 consensus_queue.cc:238] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "1db51c6148a143ceb5e9de6e049aa95f" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 34971 } }
W20261115 14:58:31.258922 15863 catalog_manager.cc:5673] Ignoring report from unknown tablet 22222222222222222222222222222222
W20261115 14:58:31.262741 15863 catalog_manager.cc:5673] Ignoring report from unknown tablet 22222222222222222222222222222222
I20261115 14:58:31.283608 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:31.306344 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:31.307284 12292 tablet_replica.cc:333] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f: stopping tablet replica
I20261115 14:58:31.308244 12292 raft_consensus.cc:2261] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:31.308669 12292 raft_consensus.cc:2290] T 22222222222222222222222222222222 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:31.311139 12292 tablet_replica.cc:333] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f: stopping tablet replica
I20261115 14:58:31.311578 12292 raft_consensus.cc:2261] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:31.311975 12292 raft_consensus.cc:2290] T 11111111111111111111111111111111 P 1db51c6148a143ceb5e9de6e049aa95f [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:31.323047 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:31.334589 12292 master.cc:585] Master@127.12.1.62:36803 shutting down...
I20261115 14:58:31.348861 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:31.349429 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:31.349869 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P e842442c080b4a7e9dd922d4ca4803ff: stopping tablet replica
I20261115 14:58:31.368695 12292 master.cc:607] Master@127.12.1.62:36803 shutdown complete.
[       OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (613 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3385 ms total)

[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN      ] FailedTabletsAreReplacedITest.OneReplica/0
I20261115 14:58:31.392428 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:36241
I20261115 14:58:31.393477 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:31.398079 16024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.399256 16025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.401024 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:31.401328 16027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.402208 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:31.402380 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:31.402495 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754711402484 us; error 0 us; skew 500 ppm
I20261115 14:58:31.402943 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:31.405176 12292 webserver.cc:577] Webserver started at http://127.12.1.62:36767/ using document root <none> and password file <none>
I20261115 14:58:31.405596 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:31.405767 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:31.406118 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:31.407212 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.411769 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:58:31.415035 16032 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.415760 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:31.416064 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.416380 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:31.438323 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:31.439376 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:31.479660 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:36241
I20261115 14:58:31.479692 16083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:36241 every 8 connection(s)
I20261115 14:58:31.485010 16084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.495715 16084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f: Bootstrap starting.
I20261115 14:58:31.500242 16084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.504058 16084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f: No bootstrap required, opened a new log
I20261115 14:58:31.506184 16084 raft_consensus.cc:360] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER }
I20261115 14:58:31.506562 16084 raft_consensus.cc:386] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.506839 16084 raft_consensus.cc:748] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9c02bcf8e94ad6bd504aea3b58ff1f, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.507471 16084 consensus_queue.cc:261] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER }
I20261115 14:58:31.507913 16084 raft_consensus.cc:400] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:31.508183 16084 raft_consensus.cc:499] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:31.508440 16084 raft_consensus.cc:3096] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:31.512792 16084 raft_consensus.cc:521] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER }
I20261115 14:58:31.513322 16084 leader_election.cc:304] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da9c02bcf8e94ad6bd504aea3b58ff1f; no voters: 
I20261115 14:58:31.514413 16084 leader_election.cc:290] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:31.514762 16087 raft_consensus.cc:2826] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:31.516021 16087 raft_consensus.cc:705] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 1 LEADER]: Becoming Leader. State: Replica: da9c02bcf8e94ad6bd504aea3b58ff1f, State: Running, Role: LEADER
I20261115 14:58:31.516808 16087 consensus_queue.cc:238] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER }
I20261115 14:58:31.517459 16084 sys_catalog.cc:565] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:31.519690 16088 sys_catalog.cc:455] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER } }
I20261115 14:58:31.519750 16089 sys_catalog.cc:455] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader da9c02bcf8e94ad6bd504aea3b58ff1f. Latest consensus state: current_term: 1 leader_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9c02bcf8e94ad6bd504aea3b58ff1f" member_type: VOTER } }
I20261115 14:58:31.520440 16089 sys_catalog.cc:458] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:31.520612 16088 sys_catalog.cc:458] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:31.524358 16092 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:31.528787 16092 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:31.533128 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:31.537279 16092 catalog_manager.cc:1398] Generated new cluster ID: 6ce8b8e77ff94fc3ad77b837e815c2b8
I20261115 14:58:31.537604 16092 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:31.563545 16092 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:31.564836 16092 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:31.577551 16092 catalog_manager.cc:6221] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f: Generated new TSK 0
I20261115 14:58:31.578205 16092 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:31.599428 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:31.605116 16105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.606556 16106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.607936 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:31.607903 16108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.609066 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:31.609279 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:31.609458 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754711609438 us; error 0 us; skew 500 ppm
I20261115 14:58:31.609997 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:31.612260 12292 webserver.cc:577] Webserver started at http://127.12.1.1:40757/ using document root <none> and password file <none>
I20261115 14:58:31.612728 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:31.612922 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:31.613193 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:31.614281 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "2c5fdcc0b55344f38615506a15313cca"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.619308 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20261115 14:58:31.622758 16113 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.623521 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:58:31.623818 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "2c5fdcc0b55344f38615506a15313cca"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.624125 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:31.632325 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:31.633342 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:31.634760 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:31.637125 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:31.637355 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.637596 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:31.637763 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.674541 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:33741
I20261115 14:58:31.674657 16175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:33741 every 8 connection(s)
I20261115 14:58:31.679401 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:31.685663 16180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.687762 16181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.688535 16183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.688856 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:31.689757 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:31.689970 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:31.690184 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754711690167 us; error 0 us; skew 500 ppm
I20261115 14:58:31.690797 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:31.693279 12292 webserver.cc:577] Webserver started at http://127.12.1.2:33521/ using document root <none> and password file <none>
I20261115 14:58:31.693826 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:31.694087 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:31.694417 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:31.695837 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "36d3d98527a744cf8674f46e764b8cf4"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.696159 16176 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36241
I20261115 14:58:31.696539 16176 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:31.697261 16176 heartbeater.cc:508] Master 127.12.1.62:36241 requested a full tablet report, sending...
I20261115 14:58:31.699343 16049 ts_manager.cc:210] Registered new tserver with Master: 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741)
I20261115 14:58:31.701485 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20261115 14:58:31.701625 16049 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52054
I20261115 14:58:31.705298 16188 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.706100 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:31.706395 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "36d3d98527a744cf8674f46e764b8cf4"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.706791 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:31.722929 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:31.724042 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:31.725608 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:31.727941 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:31.728178 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20261115 14:58:31.728417 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:31.728586 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.764372 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:45383
I20261115 14:58:31.764467 16250 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:45383 every 8 connection(s)
I20261115 14:58:31.769107 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:31.776039 16254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.778635 16255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:31.779258 16257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:31.781580 16251 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36241
I20261115 14:58:31.781657 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:31.782173 16251 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:31.782775 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:31.782984 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:31.782959 16251 heartbeater.cc:508] Master 127.12.1.62:36241 requested a full tablet report, sending...
I20261115 14:58:31.783455 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754711783432 us; error 0 us; skew 500 ppm
I20261115 14:58:31.784287 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:31.786232 16049 ts_manager.cc:210] Registered new tserver with Master: 36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383)
I20261115 14:58:31.788301 16049 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52068
I20261115 14:58:31.789480 12292 webserver.cc:577] Webserver started at http://127.12.1.3:38295/ using document root <none> and password file <none>
I20261115 14:58:31.790175 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:31.790405 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:31.790720 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:31.791821 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-2-root/instance:
uuid: "535ca9462a4e43958a55834afb353b55"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.796160 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20261115 14:58:31.799237 16262 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.799996 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:31.800362 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-2-root
uuid: "535ca9462a4e43958a55834afb353b55"
format_stamp: "Formatted at 2026-11-15 14:58:31 on dist-test-slave-fhcn"
I20261115 14:58:31.800634 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:31.810693 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:31.811805 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:31.813282 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:31.815371 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:31.815557 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.815841 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:31.815994 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:31.854090 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.3:45423
I20261115 14:58:31.854199 16324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.3:45423 every 8 connection(s)
I20261115 14:58:31.866874 16325 heartbeater.cc:345] Connected to a master server at 127.12.1.62:36241
I20261115 14:58:31.867259 16325 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:31.867955 16325 heartbeater.cc:508] Master 127.12.1.62:36241 requested a full tablet report, sending...
I20261115 14:58:31.869882 16049 ts_manager.cc:210] Registered new tserver with Master: 535ca9462a4e43958a55834afb353b55 (127.12.1.3:45423)
I20261115 14:58:31.870623 12292 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013515718s
I20261115 14:58:31.871181 16049 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52074
I20261115 14:58:31.910061 16049 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52086:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261115 14:58:31.956645 16216 tablet_service.cc:1500] Processing CreateTablet for tablet 69eb48f2cee14a0e846deb888932c78f (DEFAULT_TABLE table=test-workload [id=8365d1f49a604122941576d566e58a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:31.957676 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69eb48f2cee14a0e846deb888932c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.959877 16290 tablet_service.cc:1500] Processing CreateTablet for tablet 69eb48f2cee14a0e846deb888932c78f (DEFAULT_TABLE table=test-workload [id=8365d1f49a604122941576d566e58a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:31.961185 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69eb48f2cee14a0e846deb888932c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.964195 16141 tablet_service.cc:1500] Processing CreateTablet for tablet 69eb48f2cee14a0e846deb888932c78f (DEFAULT_TABLE table=test-workload [id=8365d1f49a604122941576d566e58a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:31.965181 16141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69eb48f2cee14a0e846deb888932c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:31.974339 16345 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: Bootstrap starting.
I20261115 14:58:31.980240 16347 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Bootstrap starting.
I20261115 14:58:31.981668 16346 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Bootstrap starting.
I20261115 14:58:31.982143 16345 tablet_bootstrap.cc:654] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.986754 16347 tablet_bootstrap.cc:654] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.988344 16345 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: No bootstrap required, opened a new log
I20261115 14:58:31.988771 16345 ts_tablet_manager.cc:1449] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20261115 14:58:31.988912 16346 tablet_bootstrap.cc:654] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:31.991719 16345 raft_consensus.cc:360] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:31.992373 16345 raft_consensus.cc:386] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.992509 16347 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: No bootstrap required, opened a new log
I20261115 14:58:31.992755 16345 raft_consensus.cc:748] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d3d98527a744cf8674f46e764b8cf4, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.993074 16347 ts_tablet_manager.cc:1449] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20261115 14:58:31.993568 16345 consensus_queue.cc:261] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:31.994855 16346 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: No bootstrap required, opened a new log
I20261115 14:58:31.995311 16346 ts_tablet_manager.cc:1449] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20261115 14:58:31.996018 16347 raft_consensus.cc:360] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:31.996759 16347 raft_consensus.cc:386] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.997100 16347 raft_consensus.cc:748] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5fdcc0b55344f38615506a15313cca, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.997762 16251 heartbeater.cc:500] Master 127.12.1.62:36241 was elected leader, sending a full tablet report...
I20261115 14:58:31.998245 16346 raft_consensus.cc:360] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:31.998961 16345 ts_tablet_manager.cc:1480] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20261115 14:58:31.998950 16346 raft_consensus.cc:386] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:31.999627 16346 raft_consensus.cc:748] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 535ca9462a4e43958a55834afb353b55, State: Initialized, Role: FOLLOWER
I20261115 14:58:31.999619 16347 consensus_queue.cc:261] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:32.000552 16346 consensus_queue.cc:261] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:32.002357 16176 heartbeater.cc:500] Master 127.12.1.62:36241 was elected leader, sending a full tablet report...
I20261115 14:58:32.003675 16347 ts_tablet_manager.cc:1480] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20261115 14:58:32.005400 16325 heartbeater.cc:500] Master 127.12.1.62:36241 was elected leader, sending a full tablet report...
I20261115 14:58:32.009054 16346 ts_tablet_manager.cc:1480] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.010s
I20261115 14:58:32.174674 16353 raft_consensus.cc:499] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:32.175130 16353 raft_consensus.cc:521] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:32.177198 16353 leader_election.cc:290] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383), 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741)
I20261115 14:58:32.185997 16226 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "69eb48f2cee14a0e846deb888932c78f" candidate_uuid: "535ca9462a4e43958a55834afb353b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d3d98527a744cf8674f46e764b8cf4" is_pre_election: true
I20261115 14:58:32.186697 16226 raft_consensus.cc:2490] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 535ca9462a4e43958a55834afb353b55 in term 0.
I20261115 14:58:32.187817 16263 leader_election.cc:304] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36d3d98527a744cf8674f46e764b8cf4, 535ca9462a4e43958a55834afb353b55; no voters: 
I20261115 14:58:32.188336 16151 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "69eb48f2cee14a0e846deb888932c78f" candidate_uuid: "535ca9462a4e43958a55834afb353b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5fdcc0b55344f38615506a15313cca" is_pre_election: true
I20261115 14:58:32.188647 16353 raft_consensus.cc:2826] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:58:32.189016 16151 raft_consensus.cc:2490] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 535ca9462a4e43958a55834afb353b55 in term 0.
I20261115 14:58:32.189055 16353 raft_consensus.cc:499] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:58:32.189610 16353 raft_consensus.cc:3096] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:32.194382 16353 raft_consensus.cc:521] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:32.196115 16353 leader_election.cc:290] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [CANDIDATE]: Term 1 election: Requested vote from peers 36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383), 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741)
I20261115 14:58:32.196878 16226 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "69eb48f2cee14a0e846deb888932c78f" candidate_uuid: "535ca9462a4e43958a55834afb353b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d3d98527a744cf8674f46e764b8cf4"
I20261115 14:58:32.197129 16151 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "69eb48f2cee14a0e846deb888932c78f" candidate_uuid: "535ca9462a4e43958a55834afb353b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5fdcc0b55344f38615506a15313cca"
I20261115 14:58:32.197361 16226 raft_consensus.cc:3096] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:32.197698 16151 raft_consensus.cc:3096] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:32.201941 16226 raft_consensus.cc:2490] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 535ca9462a4e43958a55834afb353b55 in term 1.
I20261115 14:58:32.202296 16151 raft_consensus.cc:2490] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 535ca9462a4e43958a55834afb353b55 in term 1.
I20261115 14:58:32.203126 16263 leader_election.cc:304] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36d3d98527a744cf8674f46e764b8cf4, 535ca9462a4e43958a55834afb353b55; no voters: 
I20261115 14:58:32.203928 16353 raft_consensus.cc:2826] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:32.205058 16353 raft_consensus.cc:705] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 LEADER]: Becoming Leader. State: Replica: 535ca9462a4e43958a55834afb353b55, State: Running, Role: LEADER
I20261115 14:58:32.205875 16353 consensus_queue.cc:238] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:32.212842 16355 consensus_queue.cc:1049] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20261115 14:58:32.213814 16047 catalog_manager.cc:5840] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 535ca9462a4e43958a55834afb353b55 (127.12.1.3). New cstate: current_term: 1 leader_uuid: "535ca9462a4e43958a55834afb353b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } } }
I20261115 14:58:32.215699 16357 consensus_queue.cc:1049] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:58:32.506062 16141 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:32.511397 16216 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:32.516315 16290 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 da9c02bcf8e94ad6bd504aea3b58ff1f | 127.12.1.62:36241 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 2c5fdcc0b55344f38615506a15313cca | 127.12.1.1:33741 | HEALTHY | <none>   |       0        |       0
 36d3d98527a744cf8674f46e764b8cf4 | 127.12.1.2:45383 | HEALTHY | <none>   |       0        |       0
 535ca9462a4e43958a55834afb353b55 | 127.12.1.3:45423 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20261115 14:58:32.738159 12292 log_verifier.cc:126] Checking tablet 69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:32.798631 12292 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:32.799170 12292 tablet_replica.cc:333] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: stopping tablet replica
I20261115 14:58:32.799620 12292 raft_consensus.cc:2261] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:32.800021 12292 raft_consensus.cc:2290] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:33.021850 16141 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:33.024127 16216 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:33.029480 16290 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
W20261115 14:58:33.176564 16266 consensus_peers.cc:597] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 -> Peer 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741): Couldn't send request to peer 2c5fdcc0b55344f38615506a15313cca. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:33.177690 16357 raft_consensus.cc:1022] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Attempting to remove follower 2c5fdcc0b55344f38615506a15313cca from the Raft config. Reason: The tablet replica hosted on peer 2c5fdcc0b55344f38615506a15313cca has failed
I20261115 14:58:33.179833 16357 consensus_queue.cc:238] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } }
I20261115 14:58:33.184386 16226 raft_consensus.cc:1285] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Refusing update from remote peer 535ca9462a4e43958a55834afb353b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261115 14:58:33.185811 16357 consensus_queue.cc:1049] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261115 14:58:33.192843 16416 raft_consensus.cc:2983] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } }
I20261115 14:58:33.194460 16226 raft_consensus.cc:2983] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } }
I20261115 14:58:33.206110 16048 catalog_manager.cc:5840] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 reported cstate change: config changed from index -1 to 2, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) evicted. New cstate: current_term: 1 leader_uuid: "535ca9462a4e43958a55834afb353b55" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } }
I20261115 14:58:33.222949 16141 tablet_service.cc:1547] Processing DeleteTablet for tablet 69eb48f2cee14a0e846deb888932c78f with delete_type TABLET_DATA_TOMBSTONED (TS 2c5fdcc0b55344f38615506a15313cca not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:41646
I20261115 14:58:33.225569 16421 ts_tablet_manager.cc:1962] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20261115 14:58:33.226987 16300 consensus_queue.cc:238] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:33.233399 16226 raft_consensus.cc:1285] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Refusing update from remote peer 535ca9462a4e43958a55834afb353b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20261115 14:58:33.234088 16266 consensus_peers.cc:597] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 -> Peer 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741): Couldn't send request to peer 2c5fdcc0b55344f38615506a15313cca. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:33.235001 16357 consensus_queue.cc:1049] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:58:33.240687 16421 ts_tablet_manager.cc:1975] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20261115 14:58:33.241127 16421 log.cc:1199] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1794754656521719-12292-0/minicluster-data/ts-0-root/wals/69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:33.241329 16416 raft_consensus.cc:2983] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } } }
I20261115 14:58:33.242745 16036 catalog_manager.cc:5065] TS 2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741): tablet 69eb48f2cee14a0e846deb888932c78f (table test-workload [id=8365d1f49a604122941576d566e58a23]) successfully deleted
I20261115 14:58:33.243624 16226 raft_consensus.cc:2983] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } } }
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 da9c02bcf8e94ad6bd504aea3b58ff1f | 127.12.1.62:36241 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 2c5fdcc0b55344f38615506a15313cca | 127.12.1.1:33741 | HEALTHY | <none>   |       0        |       0
 36d3d98527a744cf8674f46e764b8cf4 | 127.12.1.2:45383 | HEALTHY | <none>   |       0        |       0
 535ca9462a4e43958a55834afb353b55 | 127.12.1.3:45423 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 69eb48f2cee14a0e846deb888932c78f of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
  36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383): RUNNING
  535ca9462a4e43958a55834afb353b55 (127.12.1.3:45423): RUNNING [LEADER]
  2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741): not running
I20261115 14:58:33.252298 16033 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:VOTER RPC for tablet 69eb48f2cee14a0e846deb888932c78f with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
    State:       FAILED
    Data state:  TABLET_DATA_READY
    Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
  A = 36d3d98527a744cf8674f46e764b8cf4
  B = 535ca9462a4e43958a55834afb353b55
  C = 2c5fdcc0b55344f38615506a15313cca
The consensus matrix is:
 Config source |        Replicas        | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
 master        | A   B*  C              |              |              | Yes
 A             | A   B*  C              | 1            | -1           | Yes
 B             | A   B*  C              | 1            | -1           | Yes
 C             | [config not available] |              |              | 

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |      Status      | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | UNDER_REPLICATED | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20261115 14:58:33.257256 16049 catalog_manager.cc:5840] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 reported cstate change: config changed from index 2 to 3, VOTER 2c5fdcc0b55344f38615506a15313cca (127.12.1.1) added. New cstate: current_term: 1 leader_uuid: "535ca9462a4e43958a55834afb353b55" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } } }
I20261115 14:58:33.260388 12292 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20261115 14:58:33.622783 16141 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:33.625680 16216 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:33.628103 16449 ts_tablet_manager.cc:979] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Initiating tablet copy from peer 535ca9462a4e43958a55834afb353b55 (127.12.1.3:45423)
I20261115 14:58:33.633047 16290 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261115 14:58:33.643908 16449 tablet_copy_client.cc:323] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.3:45423
I20261115 14:58:33.656818 16310 tablet_copy_service.cc:140] P 535ca9462a4e43958a55834afb353b55: Received BeginTabletCopySession request for tablet 69eb48f2cee14a0e846deb888932c78f from peer 2c5fdcc0b55344f38615506a15313cca ({username='slave'} at 127.0.0.1:34832)
I20261115 14:58:33.657517 16310 tablet_copy_service.cc:161] P 535ca9462a4e43958a55834afb353b55: Beginning new tablet copy session on tablet 69eb48f2cee14a0e846deb888932c78f from peer 2c5fdcc0b55344f38615506a15313cca at {username='slave'} at 127.0.0.1:34832: session id = 2c5fdcc0b55344f38615506a15313cca-69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:33.665657 16310 tablet_copy_source_session.cc:215] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: Tablet Copy: opened 0 blocks and 1 log segments
I20261115 14:58:33.668624 16449 ts_tablet_manager.cc:1962] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Deleting tablet data with delete state TABLET_DATA_COPYING
I20261115 14:58:33.685506 16449 ts_tablet_manager.cc:1975] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20261115 14:58:33.686390 16449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69eb48f2cee14a0e846deb888932c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:33.694811 16449 tablet_copy_client.cc:806] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet copy: Starting download of 0 data blocks...
I20261115 14:58:33.695459 16449 tablet_copy_client.cc:670] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet copy: Starting download of 1 WAL segments...
I20261115 14:58:33.699584 16449 tablet_copy_client.cc:538] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261115 14:58:33.708710 16449 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Bootstrap starting.
I20261115 14:58:33.749382 16449 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:33.750471 16449 tablet_bootstrap.cc:492] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Bootstrap complete.
I20261115 14:58:33.751246 16449 ts_tablet_manager.cc:1449] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.015s
I20261115 14:58:33.754240 16449 raft_consensus.cc:360] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:33.755092 16449 raft_consensus.cc:748] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5fdcc0b55344f38615506a15313cca, State: Initialized, Role: FOLLOWER
I20261115 14:58:33.756117 16449 consensus_queue.cc:261] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36d3d98527a744cf8674f46e764b8cf4" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 45383 } } peers { permanent_uuid: "535ca9462a4e43958a55834afb353b55" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 45423 } } peers { permanent_uuid: "2c5fdcc0b55344f38615506a15313cca" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 33741 } }
I20261115 14:58:33.765540 16449 ts_tablet_manager.cc:1480] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20261115 14:58:33.767472 16310 tablet_copy_service.cc:342] P 535ca9462a4e43958a55834afb353b55: Request end of tablet copy session 2c5fdcc0b55344f38615506a15313cca-69eb48f2cee14a0e846deb888932c78f received from {username='slave'} at 127.0.0.1:34832
I20261115 14:58:33.767877 16310 tablet_copy_service.cc:434] P 535ca9462a4e43958a55834afb353b55: ending tablet copy session 2c5fdcc0b55344f38615506a15313cca-69eb48f2cee14a0e846deb888932c78f on tablet 69eb48f2cee14a0e846deb888932c78f with peer 2c5fdcc0b55344f38615506a15313cca
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 da9c02bcf8e94ad6bd504aea3b58ff1f | 127.12.1.62:36241 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 2c5fdcc0b55344f38615506a15313cca | 127.12.1.1:33741 | HEALTHY | <none>   |       0        |       0
 36d3d98527a744cf8674f46e764b8cf4 | 127.12.1.2:45383 | HEALTHY | <none>   |       0        |       0
 535ca9462a4e43958a55834afb353b55 | 127.12.1.3:45423 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 69eb48f2cee14a0e846deb888932c78f of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
  36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383): RUNNING
  535ca9462a4e43958a55834afb353b55 (127.12.1.3:45423): RUNNING [LEADER]
  2c5fdcc0b55344f38615506a15313cca (127.12.1.1:33741): not running
    State:       FAILED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Deleted tablet blocks from disk
All reported replicas are:
  A = 36d3d98527a744cf8674f46e764b8cf4
  B = 535ca9462a4e43958a55834afb353b55
  C = 2c5fdcc0b55344f38615506a15313cca
The consensus matrix is:
 Config source |        Replicas        | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
 master        | A   B*  C              |              |              | Yes
 A             | A   B*  C              | 1            | 3            | Yes
 B             | A   B*  C              | 1            | 3            | Yes
 C             | [config not available] |              |              | 

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |      Status      | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | UNDER_REPLICATED | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20261115 14:58:33.873195 12292 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20261115 14:58:34.004673 16151 raft_consensus.cc:1227] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3]   Dedup: 1.3->[]
I20261115 14:58:34.317550 16141 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:34.318554 16216 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:34.320043 16290 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 da9c02bcf8e94ad6bd504aea3b58ff1f | 127.12.1.62:36241 | HEALTHY

Unusual flags for Master:
                   Flag                   | Value |         Tags          |         Master
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 2c5fdcc0b55344f38615506a15313cca | 127.12.1.1:33741 | HEALTHY | <none>   |       0        |       0
 36d3d98527a744cf8674f46e764b8cf4 | 127.12.1.2:45383 | HEALTHY | <none>   |       0        |       0
 535ca9462a4e43958a55834afb353b55 | 127.12.1.3:45423 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                   Flag                   | Value |         Tags          |      Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
 raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports         | true  | unsafe                | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
 time_source         | system_unsync                                               | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20261115 14:58:34.537436 12292 log_verifier.cc:126] Checking tablet 69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:34.596786 12292 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 69eb48f2cee14a0e846deb888932c78f
I20261115 14:58:34.598877 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:34.619567 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:34.620244 12292 tablet_replica.cc:333] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca: stopping tablet replica
I20261115 14:58:34.620759 12292 raft_consensus.cc:2261] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:34.621152 12292 raft_consensus.cc:2290] T 69eb48f2cee14a0e846deb888932c78f P 2c5fdcc0b55344f38615506a15313cca [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:34.641026 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:34.650344 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:58:34.669171 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:34.669862 12292 tablet_replica.cc:333] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4: stopping tablet replica
I20261115 14:58:34.670425 12292 raft_consensus.cc:2261] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:34.670933 12292 raft_consensus.cc:2290] T 69eb48f2cee14a0e846deb888932c78f P 36d3d98527a744cf8674f46e764b8cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:34.690357 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:34.699373 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
W20261115 14:58:34.712823 16263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.1.2:45383: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20261115 14:58:34.718143 16263 consensus_peers.cc:597] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 -> Peer 36d3d98527a744cf8674f46e764b8cf4 (127.12.1.2:45383): Couldn't send request to peer 36d3d98527a744cf8674f46e764b8cf4. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.2:45383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:34.723749 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:34.724507 12292 tablet_replica.cc:333] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55: stopping tablet replica
I20261115 14:58:34.725075 12292 raft_consensus.cc:2261] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:34.725862 12292 raft_consensus.cc:2290] T 69eb48f2cee14a0e846deb888932c78f P 535ca9462a4e43958a55834afb353b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:34.745633 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:58:34.754644 12292 master.cc:585] Master@127.12.1.62:36241 shutting down...
I20261115 14:58:34.769853 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:34.770408 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:34.770735 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P da9c02bcf8e94ad6bd504aea3b58ff1f: stopping tablet replica
I20261115 14:58:34.778986 12292 master.cc:607] Master@127.12.1.62:36241 shutdown complete.
[       OK ] FailedTabletsAreReplacedITest.OneReplica/0 (3415 ms)
[ RUN      ] FailedTabletsAreReplacedITest.OneReplica/1
I20261115 14:58:34.807539 12292 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.62:44411
I20261115 14:58:34.808683 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:34.813261 16487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:34.814206 16488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:34.816051 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:34.816423 16491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:34.817296 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:34.817466 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:34.817574 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754714817563 us; error 0 us; skew 500 ppm
I20261115 14:58:34.818008 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:34.820151 12292 webserver.cc:577] Webserver started at http://127.12.1.62:36109/ using document root <none> and password file <none>
I20261115 14:58:34.820570 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:34.820724 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:34.820917 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:34.821871 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/master-0-root/instance:
uuid: "11746014f4e94c1f8310664621fd10d2"
format_stamp: "Formatted at 2026-11-15 14:58:34 on dist-test-slave-fhcn"
I20261115 14:58:34.826141 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20261115 14:58:34.829290 16495 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:34.830003 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20261115 14:58:34.830288 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/master-0-root
uuid: "11746014f4e94c1f8310664621fd10d2"
format_stamp: "Formatted at 2026-11-15 14:58:34 on dist-test-slave-fhcn"
I20261115 14:58:34.830545 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:34.848578 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:34.849604 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:34.883917 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.62:44411
I20261115 14:58:34.884011 16546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.62:44411 every 8 connection(s)
I20261115 14:58:34.887831 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:34.897866 16547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2: Bootstrap starting.
I20261115 14:58:34.902235 16547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:34.906005 16547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2: No bootstrap required, opened a new log
I20261115 14:58:34.907950 16547 raft_consensus.cc:360] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER }
I20261115 14:58:34.908413 16547 raft_consensus.cc:386] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:34.908656 16547 raft_consensus.cc:748] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11746014f4e94c1f8310664621fd10d2, State: Initialized, Role: FOLLOWER
I20261115 14:58:34.909291 16547 consensus_queue.cc:261] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER }
I20261115 14:58:34.909740 16547 raft_consensus.cc:400] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261115 14:58:34.909951 16547 raft_consensus.cc:499] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261115 14:58:34.910215 16547 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:34.914784 16547 raft_consensus.cc:521] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER }
I20261115 14:58:34.915284 16547 leader_election.cc:304] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11746014f4e94c1f8310664621fd10d2; no voters: 
I20261115 14:58:34.916442 16547 leader_election.cc:290] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261115 14:58:34.916775 16550 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:34.918044 16550 raft_consensus.cc:705] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 1 LEADER]: Becoming Leader. State: Replica: 11746014f4e94c1f8310664621fd10d2, State: Running, Role: LEADER
I20261115 14:58:34.918717 16550 consensus_queue.cc:238] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER }
I20261115 14:58:34.919282 16547 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [sys.catalog]: configured and running, proceeding with master startup.
I20261115 14:58:34.921398 16552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11746014f4e94c1f8310664621fd10d2. Latest consensus state: current_term: 1 leader_uuid: "11746014f4e94c1f8310664621fd10d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER } }
I20261115 14:58:34.921900 16552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:34.922493 16551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11746014f4e94c1f8310664621fd10d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11746014f4e94c1f8310664621fd10d2" member_type: VOTER } }
I20261115 14:58:34.923166 16551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [sys.catalog]: This master's current role is: LEADER
I20261115 14:58:34.925364 16555 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261115 14:58:34.930102 16555 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261115 14:58:34.935715 12292 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20261115 14:58:34.939350 16555 catalog_manager.cc:1398] Generated new cluster ID: 79a2d88d47814967a4cb5957018ea14d
I20261115 14:58:34.939640 16555 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261115 14:58:34.961694 16555 catalog_manager.cc:1421] Generated new certificate authority record
I20261115 14:58:34.962998 16555 catalog_manager.cc:1555] Loading token signing keys...
I20261115 14:58:34.978224 16555 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2: Generated new TSK 0
I20261115 14:58:34.978845 16555 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261115 14:58:35.002653 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:35.008667 16568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:35.009928 16569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:35.011650 16571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.012399 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:35.013361 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:35.013612 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:35.013747 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754715013736 us; error 0 us; skew 500 ppm
I20261115 14:58:35.014209 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:35.016487 12292 webserver.cc:577] Webserver started at http://127.12.1.1:35935/ using document root <none> and password file <none>
I20261115 14:58:35.016919 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:35.017068 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:35.017270 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:35.018258 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-0-root/instance:
uuid: "bbb0f45d418244d48d04021ecd8389ec"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.022683 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20261115 14:58:35.025833 16576 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.026578 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261115 14:58:35.026880 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-0-root
uuid: "bbb0f45d418244d48d04021ecd8389ec"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.027164 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:35.047613 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:35.048827 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:35.050329 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:35.052538 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:35.052762 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.053004 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:35.053176 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.090147 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.1:39917
I20261115 14:58:35.090266 16638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.1:39917 every 8 connection(s)
I20261115 14:58:35.095002 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:35.102813 16643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:35.104914 16644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.108618 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:35.108664 16639 heartbeater.cc:345] Connected to a master server at 127.12.1.62:44411
W20261115 14:58:35.109158 16646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.109402 16639 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:35.110078 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20261115 14:58:35.110198 16639 heartbeater.cc:508] Master 127.12.1.62:44411 requested a full tablet report, sending...
W20261115 14:58:35.110330 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:35.110621 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754715110603 us; error 0 us; skew 500 ppm
I20261115 14:58:35.111253 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:35.112450 16512 ts_manager.cc:210] Registered new tserver with Master: bbb0f45d418244d48d04021ecd8389ec (127.12.1.1:39917)
I20261115 14:58:35.113890 12292 webserver.cc:577] Webserver started at http://127.12.1.2:46431/ using document root <none> and password file <none>
I20261115 14:58:35.114388 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:35.114573 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:35.114529 16512 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44488
I20261115 14:58:35.115036 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:35.116366 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-1-root/instance:
uuid: "8fe194a1974a43d5b718738fd31b3c0e"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.121990 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20261115 14:58:35.125145 16651 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.125873 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261115 14:58:35.126140 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-1-root
uuid: "8fe194a1974a43d5b718738fd31b3c0e"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.126370 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:35.161975 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:35.162940 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:35.164335 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:35.166465 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:35.166635 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.166952 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:35.167109 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.203028 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.2:37917
I20261115 14:58:35.203130 16713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.2:37917 every 8 connection(s)
I20261115 14:58:35.207944 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:35.215408 16717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:35.216481 16718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.219667 16714 heartbeater.cc:345] Connected to a master server at 127.12.1.62:44411
I20261115 14:58:35.220227 16714 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:35.220829 12292 server_base.cc:1061] running on GCE node
I20261115 14:58:35.221225 16714 heartbeater.cc:508] Master 127.12.1.62:44411 requested a full tablet report, sending...
W20261115 14:58:35.221473 16721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.222435 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:35.222746 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:35.222936 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754715222889 us; error 0 us; skew 500 ppm
I20261115 14:58:35.223460 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:35.223646 16512 ts_manager.cc:210] Registered new tserver with Master: 8fe194a1974a43d5b718738fd31b3c0e (127.12.1.2:37917)
I20261115 14:58:35.225234 16512 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44496
I20261115 14:58:35.225946 12292 webserver.cc:577] Webserver started at http://127.12.1.3:41553/ using document root <none> and password file <none>
I20261115 14:58:35.226537 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:35.226737 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:35.227002 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:35.228201 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root/instance:
uuid: "f884492c5e7b4564b5a7fb92cb659710"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.232838 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20261115 14:58:35.235898 16725 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.236667 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20261115 14:58:35.236958 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root
uuid: "f884492c5e7b4564b5a7fb92cb659710"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.237233 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:35.254235 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:35.255259 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:35.256712 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:35.258859 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:35.259085 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.259335 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:35.259509 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.296871 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.3:43533
I20261115 14:58:35.296967 16787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.3:43533 every 8 connection(s)
I20261115 14:58:35.301568 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261115 14:58:35.309279 16792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261115 14:58:35.310670 16791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.314795 12292 server_base.cc:1061] running on GCE node
W20261115 14:58:35.315223 16794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261115 14:58:35.315562 16788 heartbeater.cc:345] Connected to a master server at 127.12.1.62:44411
I20261115 14:58:35.316049 16788 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:35.316329 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20261115 14:58:35.316594 12292 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20261115 14:58:35.316810 12292 hybrid_clock.cc:648] HybridClock initialized: now 1794754715316793 us; error 0 us; skew 500 ppm
I20261115 14:58:35.316943 16788 heartbeater.cc:508] Master 127.12.1.62:44411 requested a full tablet report, sending...
I20261115 14:58:35.317579 12292 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261115 14:58:35.319263 16512 ts_manager.cc:210] Registered new tserver with Master: f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533)
I20261115 14:58:35.320376 12292 webserver.cc:577] Webserver started at http://127.12.1.4:46443/ using document root <none> and password file <none>
I20261115 14:58:35.320688 16512 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44506
I20261115 14:58:35.320899 12292 fs_manager.cc:362] Metadata directory not provided
I20261115 14:58:35.321273 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261115 14:58:35.321555 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261115 14:58:35.322667 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-3-root/instance:
uuid: "84da55fad9fa4705a9343166a6f593e5"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.326942 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20261115 14:58:35.330525 16799 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.331233 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261115 14:58:35.331532 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-3-root
uuid: "84da55fad9fa4705a9343166a6f593e5"
format_stamp: "Formatted at 2026-11-15 14:58:35 on dist-test-slave-fhcn"
I20261115 14:58:35.331821 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261115 14:58:35.349151 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261115 14:58:35.350251 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261115 14:58:35.351645 12292 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261115 14:58:35.353857 12292 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261115 14:58:35.354108 12292 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.354391 12292 ts_tablet_manager.cc:662] Registered 0 tablets
I20261115 14:58:35.354532 12292 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261115 14:58:35.390071 12292 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.4:46367
I20261115 14:58:35.390166 16861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.1.4:46367 every 8 connection(s)
I20261115 14:58:35.403517 16862 heartbeater.cc:345] Connected to a master server at 127.12.1.62:44411
I20261115 14:58:35.403970 16862 heartbeater.cc:462] Registering TS with master...
I20261115 14:58:35.404724 16862 heartbeater.cc:508] Master 127.12.1.62:44411 requested a full tablet report, sending...
I20261115 14:58:35.406847 16512 ts_manager.cc:210] Registered new tserver with Master: 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4:46367)
I20261115 14:58:35.407835 12292 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014525317s
I20261115 14:58:35.408298 16512 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44514
I20261115 14:58:35.447268 16512 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44518:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261115 14:58:35.497871 16604 tablet_service.cc:1500] Processing CreateTablet for tablet f213166a4d6c45f9b956224d54c6ea6c (DEFAULT_TABLE table=test-workload [id=4620da8a2d334971921ee4521692ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:35.499238 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f213166a4d6c45f9b956224d54c6ea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:35.501766 16679 tablet_service.cc:1500] Processing CreateTablet for tablet f213166a4d6c45f9b956224d54c6ea6c (DEFAULT_TABLE table=test-workload [id=4620da8a2d334971921ee4521692ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:35.502965 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f213166a4d6c45f9b956224d54c6ea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:35.506824 16753 tablet_service.cc:1500] Processing CreateTablet for tablet f213166a4d6c45f9b956224d54c6ea6c (DEFAULT_TABLE table=test-workload [id=4620da8a2d334971921ee4521692ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261115 14:58:35.508121 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f213166a4d6c45f9b956224d54c6ea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:35.516644 16882 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: Bootstrap starting.
I20261115 14:58:35.520849 16883 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: Bootstrap starting.
I20261115 14:58:35.523723 16882 tablet_bootstrap.cc:654] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:35.525837 16884 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Bootstrap starting.
I20261115 14:58:35.527968 16883 tablet_bootstrap.cc:654] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:35.532190 16884 tablet_bootstrap.cc:654] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Neither blocks nor log segments found. Creating new log.
I20261115 14:58:35.536132 16882 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: No bootstrap required, opened a new log
I20261115 14:58:35.536661 16882 ts_tablet_manager.cc:1449] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20261115 14:58:35.538363 16883 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: No bootstrap required, opened a new log
I20261115 14:58:35.538996 16883 ts_tablet_manager.cc:1449] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20261115 14:58:35.539350 16884 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: No bootstrap required, opened a new log
I20261115 14:58:35.539497 16882 raft_consensus.cc:360] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.539856 16884 ts_tablet_manager.cc:1449] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.002s
I20261115 14:58:35.540220 16882 raft_consensus.cc:386] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:35.540532 16882 raft_consensus.cc:748] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbb0f45d418244d48d04021ecd8389ec, State: Initialized, Role: FOLLOWER
I20261115 14:58:35.541201 16882 consensus_queue.cc:261] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.541884 16883 raft_consensus.cc:360] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.542613 16883 raft_consensus.cc:386] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:35.542959 16883 raft_consensus.cc:748] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe194a1974a43d5b718738fd31b3c0e, State: Initialized, Role: FOLLOWER
I20261115 14:58:35.542845 16884 raft_consensus.cc:360] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.543511 16639 heartbeater.cc:500] Master 127.12.1.62:44411 was elected leader, sending a full tablet report...
I20261115 14:58:35.543655 16884 raft_consensus.cc:386] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261115 14:58:35.543967 16882 ts_tablet_manager.cc:1480] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20261115 14:58:35.544327 16884 raft_consensus.cc:748] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f884492c5e7b4564b5a7fb92cb659710, State: Initialized, Role: FOLLOWER
I20261115 14:58:35.543889 16883 consensus_queue.cc:261] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.545109 16884 consensus_queue.cc:261] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.549642 16883 ts_tablet_manager.cc:1480] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20261115 14:58:35.549702 16788 heartbeater.cc:500] Master 127.12.1.62:44411 was elected leader, sending a full tablet report...
I20261115 14:58:35.550124 16884 ts_tablet_manager.cc:1480] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20261115 14:58:35.551782 16714 heartbeater.cc:500] Master 127.12.1.62:44411 was elected leader, sending a full tablet report...
I20261115 14:58:35.581873 16889 raft_consensus.cc:499] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261115 14:58:35.582345 16889 raft_consensus.cc:521] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.584343 16889 leader_election.cc:290] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533), bbb0f45d418244d48d04021ecd8389ec (127.12.1.1:39917)
I20261115 14:58:35.592985 16763 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f213166a4d6c45f9b956224d54c6ea6c" candidate_uuid: "8fe194a1974a43d5b718738fd31b3c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f884492c5e7b4564b5a7fb92cb659710" is_pre_election: true
I20261115 14:58:35.593715 16763 raft_consensus.cc:2490] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe194a1974a43d5b718738fd31b3c0e in term 0.
I20261115 14:58:35.593863 16614 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f213166a4d6c45f9b956224d54c6ea6c" candidate_uuid: "8fe194a1974a43d5b718738fd31b3c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbb0f45d418244d48d04021ecd8389ec" is_pre_election: true
I20261115 14:58:35.594512 16614 raft_consensus.cc:2490] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe194a1974a43d5b718738fd31b3c0e in term 0.
I20261115 14:58:35.595085 16653 leader_election.cc:304] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe194a1974a43d5b718738fd31b3c0e, f884492c5e7b4564b5a7fb92cb659710; no voters: 
I20261115 14:58:35.595890 16889 raft_consensus.cc:2826] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261115 14:58:35.596169 16889 raft_consensus.cc:499] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261115 14:58:35.596385 16889 raft_consensus.cc:3096] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:35.601413 16889 raft_consensus.cc:521] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.602871 16889 leader_election.cc:290] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [CANDIDATE]: Term 1 election: Requested vote from peers f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533), bbb0f45d418244d48d04021ecd8389ec (127.12.1.1:39917)
I20261115 14:58:35.603667 16763 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f213166a4d6c45f9b956224d54c6ea6c" candidate_uuid: "8fe194a1974a43d5b718738fd31b3c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f884492c5e7b4564b5a7fb92cb659710"
I20261115 14:58:35.603848 16614 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f213166a4d6c45f9b956224d54c6ea6c" candidate_uuid: "8fe194a1974a43d5b718738fd31b3c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbb0f45d418244d48d04021ecd8389ec"
I20261115 14:58:35.604187 16763 raft_consensus.cc:3096] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:35.604534 16614 raft_consensus.cc:3096] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 0 FOLLOWER]: Advancing to term 1
I20261115 14:58:35.609145 16763 raft_consensus.cc:2490] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe194a1974a43d5b718738fd31b3c0e in term 1.
I20261115 14:58:35.609810 16614 raft_consensus.cc:2490] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe194a1974a43d5b718738fd31b3c0e in term 1.
I20261115 14:58:35.610234 16653 leader_election.cc:304] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe194a1974a43d5b718738fd31b3c0e, f884492c5e7b4564b5a7fb92cb659710; no voters: 
I20261115 14:58:35.611073 16889 raft_consensus.cc:2826] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 FOLLOWER]: Leader election won for term 1
I20261115 14:58:35.611927 16889 raft_consensus.cc:705] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 LEADER]: Becoming Leader. State: Replica: 8fe194a1974a43d5b718738fd31b3c0e, State: Running, Role: LEADER
I20261115 14:58:35.612636 16889 consensus_queue.cc:238] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:35.620075 16892 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:58:35.620951 16894 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261115 14:58:35.620790 16510 catalog_manager.cc:5840] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fe194a1974a43d5b718738fd31b3c0e (127.12.1.2). New cstate: current_term: 1 leader_uuid: "8fe194a1974a43d5b718738fd31b3c0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f884492c5e7b4564b5a7fb92cb659710" member_type: VOTER last_known_addr { host: "127.12.1.3" port: 43533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } health_report { overall_health: HEALTHY } } }
I20261115 14:58:35.917430 16679 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261115 14:58:35.917939 16827 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:35.920598 16604 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:35.928258 16753 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 11746014f4e94c1f8310664621fd10d2 | 127.12.1.62:44411 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | HEALTHY | <none>   |       0        |       0
 8fe194a1974a43d5b718738fd31b3c0e | 127.12.1.2:37917 | HEALTHY | <none>   |       1        |       0
 bbb0f45d418244d48d04021ecd8389ec | 127.12.1.1:39917 | HEALTHY | <none>   |       0        |       0
 f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |       Host       | Replica Count
-------+----------------------------------+------------------+---------------
 Small | 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20261115 14:58:36.210731 12292 log_verifier.cc:126] Checking tablet f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:36.273738 12292 log_verifier.cc:177] Verified matching terms for 1 ops in tablet f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:36.274283 12292 tablet_replica.cc:333] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: stopping tablet replica
I20261115 14:58:36.274837 12292 raft_consensus.cc:2261] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:36.275327 12292 raft_consensus.cc:2290] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:36.410748 16862 heartbeater.cc:500] Master 127.12.1.62:44411 was elected leader, sending a full tablet report...
I20261115 14:58:36.521641 16827 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:36.530118 16679 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261115 14:58:36.533735 16604 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:36.538738 16753 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:36.668504 16653 consensus_queue.cc:580] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: The tablet replica hosted on peer f884492c5e7b4564b5a7fb92cb659710 has failed
W20261115 14:58:36.668962 16653 consensus_peers.cc:597] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e -> Peer f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533): Couldn't send request to peer f884492c5e7b4564b5a7fb92cb659710. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:36.690878 16689 consensus_queue.cc:238] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } }
I20261115 14:58:36.710573 16614 raft_consensus.cc:1285] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Refusing update from remote peer 8fe194a1974a43d5b718738fd31b3c0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261115 14:58:36.712555 16898 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261115 14:58:36.734470 16959 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } }
I20261115 14:58:36.736588 16614 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } }
I20261115 14:58:36.744720 16499 catalog_manager.cc:5247] ChangeConfig:REMOVE_PEER RPC for tablet f213166a4d6c45f9b956224d54c6ea6c with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20261115 14:58:36.748505 16511 catalog_manager.cc:5840] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e reported cstate change: config changed from index -1 to 2, VOTER f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3) evicted. New cstate: current_term: 1 leader_uuid: "8fe194a1974a43d5b718738fd31b3c0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } health_report { overall_health: HEALTHY } } }
I20261115 14:58:36.787902 16753 tablet_service.cc:1547] Processing DeleteTablet for tablet f213166a4d6c45f9b956224d54c6ea6c with delete_type TABLET_DATA_TOMBSTONED (TS f884492c5e7b4564b5a7fb92cb659710 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:53452
I20261115 14:58:36.790597 16967 ts_tablet_manager.cc:1962] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20261115 14:58:36.791860 16689 consensus_queue.cc:238] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } }
I20261115 14:58:36.806887 16967 ts_tablet_manager.cc:1975] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20261115 14:58:36.807461 16967 log.cc:1199] T f213166a4d6c45f9b956224d54c6ea6c P f884492c5e7b4564b5a7fb92cb659710: Deleting WAL directory at /tmp/dist-test-taskxbr1tW/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1794754656521719-12292-0/minicluster-data/ts-2-root/wals/f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:36.809680 16497 catalog_manager.cc:5065] TS f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533): tablet f213166a4d6c45f9b956224d54c6ea6c (table test-workload [id=4620da8a2d334971921ee4521692ca8a]) successfully deleted
I20261115 14:58:36.813040 16614 raft_consensus.cc:1285] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Refusing update from remote peer 8fe194a1974a43d5b718738fd31b3c0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261115 14:58:36.814977 16898 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261115 14:58:36.822873 16959 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } } }
W20261115 14:58:36.824019 16654 consensus_peers.cc:597] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e -> Peer 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4:46367): Couldn't send request to peer 84da55fad9fa4705a9343166a6f593e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f213166a4d6c45f9b956224d54c6ea6c. This is attempt 1: this message will repeat every 5th retry.
I20261115 14:58:36.824697 16614 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } } }
I20261115 14:58:36.832664 16499 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f213166a4d6c45f9b956224d54c6ea6c with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261115 14:58:36.837525 16511 catalog_manager.cc:5840] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec reported cstate change: config changed from index 2 to 3, NON_VOTER 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) added. New cstate: current_term: 1 leader_uuid: "8fe194a1974a43d5b718738fd31b3c0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } } }
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 11746014f4e94c1f8310664621fd10d2 | 127.12.1.62:44411 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | HEALTHY | <none>   |       0        |       0
 8fe194a1974a43d5b718738fd31b3c0e | 127.12.1.2:37917 | HEALTHY | <none>   |       1        |       0
 bbb0f45d418244d48d04021ecd8389ec | 127.12.1.1:39917 | HEALTHY | <none>   |       0        |       0
 f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet f213166a4d6c45f9b956224d54c6ea6c of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
  f884492c5e7b4564b5a7fb92cb659710 (127.12.1.3:43533): not running
    State:       FAILED
    Data state:  TABLET_DATA_READY
    Last status: IO error: INJECTED ERROR: tablet failed
  bbb0f45d418244d48d04021ecd8389ec (127.12.1.1:39917): RUNNING
  8fe194a1974a43d5b718738fd31b3c0e (127.12.1.2:37917): RUNNING [LEADER]
All reported replicas are:
  A = f884492c5e7b4564b5a7fb92cb659710
  B = bbb0f45d418244d48d04021ecd8389ec
  C = 8fe194a1974a43d5b718738fd31b3c0e
The consensus matrix is:
 Config source |        Replicas        | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
 master        | A   B   C*             |              |              | Yes
 A             | [config not available] |              |              | 
 B             | A   B   C*             | 1            | -1           | Yes
 C             | A   B   C*             | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |      Status      | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | UNDER_REPLICATED | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |       Host       | Replica Count
-------+----------------------------------+------------------+---------------
 Small | 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20261115 14:58:36.856251 12292 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20261115 14:58:37.215462 16983 ts_tablet_manager.cc:979] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Initiating tablet copy from peer 8fe194a1974a43d5b718738fd31b3c0e (127.12.1.2:37917)
I20261115 14:58:37.217797 16983 tablet_copy_client.cc:323] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.2:37917
I20261115 14:58:37.232347 16699 tablet_copy_service.cc:140] P 8fe194a1974a43d5b718738fd31b3c0e: Received BeginTabletCopySession request for tablet f213166a4d6c45f9b956224d54c6ea6c from peer 84da55fad9fa4705a9343166a6f593e5 ({username='slave'} at 127.0.0.1:56792)
I20261115 14:58:37.233345 16699 tablet_copy_service.cc:161] P 8fe194a1974a43d5b718738fd31b3c0e: Beginning new tablet copy session on tablet f213166a4d6c45f9b956224d54c6ea6c from peer 84da55fad9fa4705a9343166a6f593e5 at {username='slave'} at 127.0.0.1:56792: session id = 84da55fad9fa4705a9343166a6f593e5-f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:37.242398 16699 tablet_copy_source_session.cc:215] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: Tablet Copy: opened 0 blocks and 1 log segments
I20261115 14:58:37.245893 16983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f213166a4d6c45f9b956224d54c6ea6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261115 14:58:37.264300 16983 tablet_copy_client.cc:806] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: tablet copy: Starting download of 0 data blocks...
I20261115 14:58:37.264891 16983 tablet_copy_client.cc:670] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: tablet copy: Starting download of 1 WAL segments...
I20261115 14:58:37.268774 16983 tablet_copy_client.cc:538] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261115 14:58:37.275352 16983 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Bootstrap starting.
I20261115 14:58:37.300405 16983 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261115 14:58:37.301719 16983 tablet_bootstrap.cc:492] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Bootstrap complete.
I20261115 14:58:37.302701 16983 ts_tablet_manager.cc:1449] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Time spent bootstrapping tablet: real 0.028s	user 0.025s	sys 0.003s
I20261115 14:58:37.306945 16983 raft_consensus.cc:360] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } }
I20261115 14:58:37.308491 16983 raft_consensus.cc:748] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 84da55fad9fa4705a9343166a6f593e5, State: Initialized, Role: LEARNER
I20261115 14:58:37.309327 16983 consensus_queue.cc:261] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: NON_VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: true } }
I20261115 14:58:37.322571 16827 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:37.322516 16983 ts_tablet_manager.cc:1480] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.011s
I20261115 14:58:37.330556 16699 tablet_copy_service.cc:342] P 8fe194a1974a43d5b718738fd31b3c0e: Request end of tablet copy session 84da55fad9fa4705a9343166a6f593e5-f213166a4d6c45f9b956224d54c6ea6c received from {username='slave'} at 127.0.0.1:56792
I20261115 14:58:37.331188 16699 tablet_copy_service.cc:434] P 8fe194a1974a43d5b718738fd31b3c0e: ending tablet copy session 84da55fad9fa4705a9343166a6f593e5-f213166a4d6c45f9b956224d54c6ea6c on tablet f213166a4d6c45f9b956224d54c6ea6c with peer 84da55fad9fa4705a9343166a6f593e5
I20261115 14:58:37.335888 16679 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261115 14:58:37.341032 16604 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:37.358179 16753 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 11746014f4e94c1f8310664621fd10d2 | 127.12.1.62:44411 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | HEALTHY | <none>   |       0        |       0
 8fe194a1974a43d5b718738fd31b3c0e | 127.12.1.2:37917 | HEALTHY | <none>   |       1        |       0
 bbb0f45d418244d48d04021ecd8389ec | 127.12.1.1:39917 | HEALTHY | <none>   |       0        |       0
 f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet f213166a4d6c45f9b956224d54c6ea6c of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  bbb0f45d418244d48d04021ecd8389ec (127.12.1.1:39917): RUNNING
  8fe194a1974a43d5b718738fd31b3c0e (127.12.1.2:37917): RUNNING [LEADER]
  84da55fad9fa4705a9343166a6f593e5 (127.12.1.4:46367): not running [NONVOTER]
    State:       BOOTSTRAPPING
    Data state:  TABLET_DATA_READY
    Last status: Bootstrap complete.
All reported replicas are:
  A = bbb0f45d418244d48d04021ecd8389ec
  B = 8fe194a1974a43d5b718738fd31b3c0e
  C = 84da55fad9fa4705a9343166a6f593e5
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C~   |              |              | Yes
 A             | A   B*  C~   | 1            | 3            | Yes
 B             | A   B*  C~   | 1            | 3            | Yes
 C             | A   B   C~   | 1            | 3            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |       Host       | Replica Count
-------+----------------------------------+------------------+---------------
 Small | f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20261115 14:58:37.610399 12292 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20261115 14:58:37.732620 16837 raft_consensus.cc:1227] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3]   Dedup: 1.3->[]
I20261115 14:58:38.071370 16679 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261115 14:58:38.071993 16604 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:38.080354 16827 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:38.081123 16753 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261115 14:58:38.166767 17005 raft_consensus.cc:1074] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: attempting to promote NON_VOTER 84da55fad9fa4705a9343166a6f593e5 to VOTER
I20261115 14:58:38.169063 17005 consensus_queue.cc:238] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false } }
I20261115 14:58:38.205412 16837 raft_consensus.cc:1285] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 LEARNER]: Refusing update from remote peer 8fe194a1974a43d5b718738fd31b3c0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20261115 14:58:38.207525 16969 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20261115 14:58:38.217803 16614 raft_consensus.cc:1285] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Refusing update from remote peer 8fe194a1974a43d5b718738fd31b3c0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20261115 14:58:38.221333 17005 consensus_queue.cc:1049] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20261115 14:58:38.236779 16969 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false } } }
I20261115 14:58:38.242272 16614 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false } } }
I20261115 14:58:38.251195 16837 raft_consensus.cc:2983] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false } } }
I20261115 14:58:38.261511 16510 catalog_manager.cc:5840] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e reported cstate change: config changed from index 3 to 4, 84da55fad9fa4705a9343166a6f593e5 (127.12.1.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8fe194a1974a43d5b718738fd31b3c0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbb0f45d418244d48d04021ecd8389ec" member_type: VOTER last_known_addr { host: "127.12.1.1" port: 39917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe194a1974a43d5b718738fd31b3c0e" member_type: VOTER last_known_addr { host: "127.12.1.2" port: 37917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84da55fad9fa4705a9343166a6f593e5" member_type: VOTER last_known_addr { host: "127.12.1.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
Master Summary
               UUID               |      Address      | Status
----------------------------------+-------------------+---------
 11746014f4e94c1f8310664621fd10d2 | 127.12.1.62:44411 | HEALTHY

Unusual flags for Master:
               Flag               | Value |  Tags  |         Master
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |                            Value                            |         Master
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
 time_source         | system_unsync                                               | all 1 server(s) checked

Tablet Server Summary
               UUID               |     Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+------------------+---------+----------+----------------+-----------------
 84da55fad9fa4705a9343166a6f593e5 | 127.12.1.4:46367 | HEALTHY | <none>   |       0        |       0
 8fe194a1974a43d5b718738fd31b3c0e | 127.12.1.2:37917 | HEALTHY | <none>   |       1        |       0
 bbb0f45d418244d48d04021ecd8389ec | 127.12.1.1:39917 | HEALTHY | <none>   |       0        |       0
 f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
               Flag               | Value |  Tags  |      Tablet Server
----------------------------------+-------+--------+-------------------------
 rpc_server_allow_ephemeral_ports | true  | unsafe | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |                            Value                            |      Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
 builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
 time_source         | system_unsync                                               | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 0
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Tablet Replica Count Outliers
 Type  |               UUID               |       Host       | Replica Count
-------+----------------------------------+------------------+---------------
 Small | f884492c5e7b4564b5a7fb92cb659710 | 127.12.1.3:43533 | 0

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20261115 14:58:38.423198 12292 log_verifier.cc:126] Checking tablet f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:38.481616 12292 log_verifier.cc:177] Verified matching terms for 4 ops in tablet f213166a4d6c45f9b956224d54c6ea6c
I20261115 14:58:38.486264 12292 tablet_server.cc:179] TabletServer@127.12.1.1:0 shutting down...
I20261115 14:58:38.510802 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:38.511507 12292 tablet_replica.cc:333] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec: stopping tablet replica
I20261115 14:58:38.511988 12292 raft_consensus.cc:2261] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:38.512574 12292 raft_consensus.cc:2290] T f213166a4d6c45f9b956224d54c6ea6c P bbb0f45d418244d48d04021ecd8389ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:38.533792 12292 tablet_server.cc:196] TabletServer@127.12.1.1:0 shutdown complete.
I20261115 14:58:38.545111 12292 tablet_server.cc:179] TabletServer@127.12.1.2:0 shutting down...
I20261115 14:58:38.567190 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:38.567864 12292 tablet_replica.cc:333] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e: stopping tablet replica
I20261115 14:58:38.568403 12292 raft_consensus.cc:2261] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:38.569166 12292 raft_consensus.cc:2290] T f213166a4d6c45f9b956224d54c6ea6c P 8fe194a1974a43d5b718738fd31b3c0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:38.590090 12292 tablet_server.cc:196] TabletServer@127.12.1.2:0 shutdown complete.
I20261115 14:58:38.601181 12292 tablet_server.cc:179] TabletServer@127.12.1.3:0 shutting down...
I20261115 14:58:38.623746 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:38.641263 12292 tablet_server.cc:196] TabletServer@127.12.1.3:0 shutdown complete.
I20261115 14:58:38.652367 12292 tablet_server.cc:179] TabletServer@127.12.1.4:0 shutting down...
I20261115 14:58:38.672886 12292 ts_tablet_manager.cc:1553] Shutting down tablet manager...
I20261115 14:58:38.673506 12292 tablet_replica.cc:333] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5: stopping tablet replica
I20261115 14:58:38.673942 12292 raft_consensus.cc:2261] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261115 14:58:38.674343 12292 raft_consensus.cc:2290] T f213166a4d6c45f9b956224d54c6ea6c P 84da55fad9fa4705a9343166a6f593e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:38.693948 12292 tablet_server.cc:196] TabletServer@127.12.1.4:0 shutdown complete.
I20261115 14:58:38.704404 12292 master.cc:585] Master@127.12.1.62:44411 shutting down...
I20261115 14:58:38.722565 12292 raft_consensus.cc:2261] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 1 LEADER]: Raft consensus shutting down.
I20261115 14:58:38.723086 12292 raft_consensus.cc:2290] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261115 14:58:38.723380 12292 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11746014f4e94c1f8310664621fd10d2: stopping tablet replica
I20261115 14:58:38.741622 12292 master.cc:607] Master@127.12.1.62:44411 shutdown complete.
[       OK ] FailedTabletsAreReplacedITest.OneReplica/1 (3964 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (7380 ms total)

[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (62082 ms total)
[  PASSED  ] 11 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[  FAILED  ] 1 test, listed below:
[  FAILED  ] TsTabletManagerITest.TestTableStats

 1 FAILED TEST
I20261115 14:58:38.779969 12292 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~8 seconds ago
I20261115 14:58:38.780364 12292 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:648: suppressed but not reported on 78 messages since previous log ~56 seconds ago
I20261115 14:58:38.780637 12292 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2441: suppressed but not reported on 6 messages since previous log ~11 seconds ago