[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 07:47:55.173662 1645 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.220s user 0.000s sys 0.005s
W20260808 07:47:55.174268 1645 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.220s user 0.000s sys 0.005s
I20260808 07:47:55.180078 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:44925
I20260808 07:47:55.183591 1645 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:47:55.185817 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:47:55.208391 1660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:47:55.210160 1661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:47:55.416042 1663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:47:55.417448 1645 server_base.cc:1061] running on GCE node
I20260808 07:47:55.418807 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:47:55.419143 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:47:55.419332 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175275419310 us; error 0 us; skew 500 ppm
I20260808 07:47:55.420588 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:47:55.427654 1645 webserver.cc:533] Webserver started at http://127.1.155.126:46805/ using document root <none> and password file <none>
I20260808 07:47:55.429251 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:47:55.429492 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:47:55.430191 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:47:55.438024 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "78db216e82854dd38daaebac22677474"
format_stamp: "Formatted at 2026-08-08 07:47:55 on dist-test-slave-pww0"
I20260808 07:47:55.452229 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.013s user 0.006s sys 0.005s
I20260808 07:47:55.460430 1670 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:55.462467 1645 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 07:47:55.462952 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "78db216e82854dd38daaebac22677474"
format_stamp: "Formatted at 2026-08-08 07:47:55 on dist-test-slave-pww0"
I20260808 07:47:55.463353 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:47:55.501116 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:47:55.503141 1645 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:47:55.503707 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:47:55.642889 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:44925
I20260808 07:47:55.642999 1748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:44925 every 8 connection(s)
I20260808 07:47:55.654296 1749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:47:55.689201 1749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: Bootstrap starting.
I20260808 07:47:55.700232 1749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: Neither blocks nor log segments found. Creating new log.
I20260808 07:47:55.704272 1749 log.cc:826] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: Log is configured to *not* fsync() on all Append() calls
I20260808 07:47:55.711570 1749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: No bootstrap required, opened a new log
I20260808 07:47:55.740061 1749 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER }
I20260808 07:47:55.740908 1749 raft_consensus.cc:385] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:47:55.741241 1749 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78db216e82854dd38daaebac22677474, State: Initialized, Role: FOLLOWER
I20260808 07:47:55.742782 1749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER }
I20260808 07:47:55.743398 1749 raft_consensus.cc:399] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:47:55.743793 1749 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:47:55.744272 1749 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:47:55.756417 1749 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER }
I20260808 07:47:55.757877 1749 leader_election.cc:304] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78db216e82854dd38daaebac22677474; no voters:
I20260808 07:47:55.760792 1749 leader_election.cc:290] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:47:55.761358 1752 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:47:55.765561 1752 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 1 LEADER]: Becoming Leader. State: Replica: 78db216e82854dd38daaebac22677474, State: Running, Role: LEADER
I20260808 07:47:55.766721 1752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER }
I20260808 07:47:55.767741 1749 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:47:55.781618 1755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78db216e82854dd38daaebac22677474. Latest consensus state: current_term: 1 leader_uuid: "78db216e82854dd38daaebac22677474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER } }
I20260808 07:47:55.782688 1755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [sys.catalog]: This master's current role is: LEADER
I20260808 07:47:55.781260 1753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78db216e82854dd38daaebac22677474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78db216e82854dd38daaebac22677474" member_type: VOTER } }
I20260808 07:47:55.783143 1753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [sys.catalog]: This master's current role is: LEADER
I20260808 07:47:55.789494 1766 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:47:55.809832 1766 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:47:55.813318 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:47:55.834501 1766 catalog_manager.cc:1383] Generated new cluster ID: 16c84919304449e8a9537a475c707099
I20260808 07:47:55.834936 1766 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:47:55.854118 1766 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:47:55.856396 1766 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:47:55.875437 1766 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: Generated new TSK 0
I20260808 07:47:55.877133 1766 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:47:55.945982 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:47:55.961512 1780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:47:55.962430 1782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:47:55.971923 1645 server_base.cc:1061] running on GCE node
W20260808 07:47:55.971706 1787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:47:55.973080 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:47:55.973312 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:47:55.973486 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175275973463 us; error 0 us; skew 500 ppm
I20260808 07:47:55.974124 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:47:55.979823 1645 webserver.cc:533] Webserver started at http://127.1.155.65:42857/ using document root <none> and password file <none>
I20260808 07:47:55.980422 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:47:55.980656 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:47:55.980962 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:47:55.982161 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "56fedb1945204171a71642e6f845830d"
format_stamp: "Formatted at 2026-08-08 07:47:55 on dist-test-slave-pww0"
I20260808 07:47:55.989095 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 07:47:55.995710 1796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:55.996768 1645 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.005s
I20260808 07:47:55.997077 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "56fedb1945204171a71642e6f845830d"
format_stamp: "Formatted at 2026-08-08 07:47:55 on dist-test-slave-pww0"
I20260808 07:47:55.997373 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:47:56.035666 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:47:56.037386 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:47:56.041064 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:47:56.047778 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:47:56.048138 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:56.048422 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:47:56.048573 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:56.288033 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:32847
I20260808 07:47:56.288225 1898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:32847 every 8 connection(s)
I20260808 07:47:56.301213 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:47:56.317507 1903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:47:56.319967 1905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:47:56.332854 1910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:47:56.333398 1645 server_base.cc:1061] running on GCE node
I20260808 07:47:56.334488 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:47:56.334702 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:47:56.334864 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175276334848 us; error 0 us; skew 500 ppm
I20260808 07:47:56.335393 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:47:56.341699 1645 webserver.cc:533] Webserver started at http://127.1.155.66:42329/ using document root <none> and password file <none>
I20260808 07:47:56.342253 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:47:56.342440 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:47:56.342720 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:47:56.344002 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "1f6da230b0814f88915320b8ab2e69d6"
format_stamp: "Formatted at 2026-08-08 07:47:56 on dist-test-slave-pww0"
I20260808 07:47:56.350324 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 07:47:56.356177 1899 heartbeater.cc:344] Connected to a master server at 127.1.155.126:44925
I20260808 07:47:56.356974 1899 heartbeater.cc:461] Registering TS with master...
I20260808 07:47:56.358763 1919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:56.359108 1899 heartbeater.cc:507] Master 127.1.155.126:44925 requested a full tablet report, sending...
I20260808 07:47:56.360222 1645 fs_manager.cc:730] Time spent opening block manager: real 0.008s user 0.001s sys 0.003s
I20260808 07:47:56.360587 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "1f6da230b0814f88915320b8ab2e69d6"
format_stamp: "Formatted at 2026-08-08 07:47:56 on dist-test-slave-pww0"
I20260808 07:47:56.360968 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:47:56.365608 1695 ts_manager.cc:194] Registered new tserver with Master: 56fedb1945204171a71642e6f845830d (127.1.155.65:32847)
I20260808 07:47:56.370991 1695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35928
I20260808 07:47:56.392211 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:47:56.395584 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:47:56.397594 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:47:56.400758 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:47:56.401036 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:56.401331 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:47:56.401538 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:47:56.477048 1899 heartbeater.cc:499] Master 127.1.155.126:44925 was elected leader, sending a full tablet report...
I20260808 07:47:56.701953 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:43581
I20260808 07:47:56.702432 2017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:43581 every 8 connection(s)
I20260808 07:47:56.738917 2020 heartbeater.cc:344] Connected to a master server at 127.1.155.126:44925
I20260808 07:47:56.739480 2020 heartbeater.cc:461] Registering TS with master...
I20260808 07:47:56.740983 2020 heartbeater.cc:507] Master 127.1.155.126:44925 requested a full tablet report, sending...
I20260808 07:47:56.744450 1695 ts_manager.cc:194] Registered new tserver with Master: 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66:43581)
I20260808 07:47:56.744544 1645 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.019273486s
I20260808 07:47:56.746985 1695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35932
I20260808 07:47:56.811340 1695 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:47:56.850112 1695 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260808 07:47:56.851259 2020 heartbeater.cc:499] Master 127.1.155.126:44925 was elected leader, sending a full tablet report...
I20260808 07:47:56.991194 1841 tablet_service.cc:1511] Processing CreateTablet for tablet 08777a554c294e6c97842871fe954c5e (DEFAULT_TABLE table=test-table [id=b44e95436ba44262b7fd4f9a47bf5997]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 07:47:56.992106 1840 tablet_service.cc:1511] Processing CreateTablet for tablet 1c734e3d84c243e0ab44a8a24a8e50fb (DEFAULT_TABLE table=test-table [id=b44e95436ba44262b7fd4f9a47bf5997]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 07:47:56.994374 1841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08777a554c294e6c97842871fe954c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:47:56.995276 1840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c734e3d84c243e0ab44a8a24a8e50fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:47:57.006805 1959 tablet_service.cc:1511] Processing CreateTablet for tablet 08777a554c294e6c97842871fe954c5e (DEFAULT_TABLE table=test-table [id=b44e95436ba44262b7fd4f9a47bf5997]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 07:47:57.008298 1958 tablet_service.cc:1511] Processing CreateTablet for tablet 1c734e3d84c243e0ab44a8a24a8e50fb (DEFAULT_TABLE table=test-table [id=b44e95436ba44262b7fd4f9a47bf5997]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 07:47:57.010622 1959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08777a554c294e6c97842871fe954c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:47:57.011615 1958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c734e3d84c243e0ab44a8a24a8e50fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:47:57.048906 2043 tablet_bootstrap.cc:492] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: Bootstrap starting.
I20260808 07:47:57.060029 2043 tablet_bootstrap.cc:654] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: Neither blocks nor log segments found. Creating new log.
I20260808 07:47:57.069047 2047 tablet_bootstrap.cc:492] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: Bootstrap starting.
I20260808 07:47:57.074110 2043 tablet_bootstrap.cc:492] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: No bootstrap required, opened a new log
I20260808 07:47:57.074721 2043 ts_tablet_manager.cc:1403] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.015s
I20260808 07:47:57.078159 2043 raft_consensus.cc:359] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.078760 2043 raft_consensus.cc:740] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56fedb1945204171a71642e6f845830d, State: Initialized, Role: FOLLOWER
I20260808 07:47:57.079372 2043 consensus_queue.cc:260] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.080981 2047 tablet_bootstrap.cc:654] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: Neither blocks nor log segments found. Creating new log.
I20260808 07:47:57.086280 2043 ts_tablet_manager.cc:1434] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: Time spent starting tablet: real 0.011s user 0.000s sys 0.013s
I20260808 07:47:57.087623 2043 tablet_bootstrap.cc:492] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: Bootstrap starting.
I20260808 07:47:57.100281 2043 tablet_bootstrap.cc:654] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: Neither blocks nor log segments found. Creating new log.
I20260808 07:47:57.102252 2047 tablet_bootstrap.cc:492] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: No bootstrap required, opened a new log
I20260808 07:47:57.102905 2047 ts_tablet_manager.cc:1403] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.014s
I20260808 07:47:57.108527 2047 raft_consensus.cc:359] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.109268 2047 raft_consensus.cc:740] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Initialized, Role: FOLLOWER
I20260808 07:47:57.110097 2047 consensus_queue.cc:260] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.117822 2047 ts_tablet_manager.cc:1434] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: Time spent starting tablet: real 0.015s user 0.003s sys 0.007s
I20260808 07:47:57.118718 2043 tablet_bootstrap.cc:492] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: No bootstrap required, opened a new log
I20260808 07:47:57.119176 2043 ts_tablet_manager.cc:1403] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.013s
I20260808 07:47:57.121537 2047 tablet_bootstrap.cc:492] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: Bootstrap starting.
I20260808 07:47:57.122476 2043 raft_consensus.cc:359] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.123198 2043 raft_consensus.cc:740] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56fedb1945204171a71642e6f845830d, State: Initialized, Role: FOLLOWER
I20260808 07:47:57.123885 2043 consensus_queue.cc:260] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.126148 2043 ts_tablet_manager.cc:1434] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 07:47:57.136339 2047 tablet_bootstrap.cc:654] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: Neither blocks nor log segments found. Creating new log.
I20260808 07:47:57.147680 2047 tablet_bootstrap.cc:492] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: No bootstrap required, opened a new log
I20260808 07:47:57.148307 2047 ts_tablet_manager.cc:1403] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.003s
I20260808 07:47:57.151885 2047 raft_consensus.cc:359] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.152667 2047 raft_consensus.cc:740] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Initialized, Role: FOLLOWER
I20260808 07:47:57.153381 2047 consensus_queue.cc:260] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.155506 2047 ts_tablet_manager.cc:1434] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260808 07:47:57.204844 1645 ts_tablet_manager-itest.cc:368] Electing peer 2...
I20260808 07:47:57.205197 1645 raft_consensus.cc:423] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Emulating election...
I20260808 07:47:57.205493 1645 raft_consensus.cc:3060] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:47:57.209935 1645 raft_consensus.cc:697] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:47:57.210738 1645 consensus_queue.cc:237] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.226920 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
W20260808 07:47:57.227394 2021 tablet.cc:2406] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:47:57.249879 1694 catalog_manager.cc:5697] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66). New cstate: current_term: 1 leader_uuid: "1f6da230b0814f88915320b8ab2e69d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: HEALTHY } } }
I20260808 07:47:57.284504 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:57.392467 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:57.597412 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:57.798666 1860 raft_consensus.cc:3060] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:47:57.806743 2061 consensus_queue.cc:1048] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 07:47:57.902158 1645 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 07:47:57.902405 1645 raft_consensus.cc:423] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Emulating election...
I20260808 07:47:57.902657 1645 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:47:57.906976 1645 raft_consensus.cc:697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:47:57.907693 1645 consensus_queue.cc:237] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:57.910048 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:47:57.914464 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:57.914309 1694 catalog_manager.cc:5697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66). New cstate: current_term: 1 leader_uuid: "1f6da230b0814f88915320b8ab2e69d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: HEALTHY } } }
I20260808 07:47:58.018905 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:58.224681 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 07:47:58.376546 1860 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:47:58.382808 2068 consensus_queue.cc:1048] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:47:58.730131 1645 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 07:47:58.730399 1645 raft_consensus.cc:423] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Emulating election...
I20260808 07:47:58.730638 1645 raft_consensus.cc:3055] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:47:58.730806 1645 raft_consensus.cc:740] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:47:58.731235 1645 consensus_queue.cc:260] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:58.732153 1645 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:47:58.736316 1645 raft_consensus.cc:697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 2 LEADER]: Becoming Leader. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:47:58.736980 1645 consensus_queue.cc:237] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:58.738603 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:47:58.744015 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 07:47:58.744208 1694 catalog_manager.cc:5697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "1f6da230b0814f88915320b8ab2e69d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: HEALTHY } } }
I20260808 07:47:58.848619 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 07:47:59.054385 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 07:47:59.280069 1856 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:47:59.290213 1856 raft_consensus.cc:1275] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 2 FOLLOWER]: Refusing update from remote peer 1f6da230b0814f88915320b8ab2e69d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 07:47:59.292323 2068 consensus_queue.cc:1048] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 07:47:59.361119 1645 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 07:47:59.361359 1645 raft_consensus.cc:423] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 2 FOLLOWER]: Emulating election...
I20260808 07:47:59.361572 1645 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:47:59.366250 1645 raft_consensus.cc:697] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 3 LEADER]: Becoming Leader. State: Replica: 56fedb1945204171a71642e6f845830d, State: Running, Role: LEADER
I20260808 07:47:59.367005 1645 consensus_queue.cc:237] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:59.368600 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:47:59.374954 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 07:47:59.375233 1695 catalog_manager.cc:5697] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d reported cstate change: term changed from 2 to 3, leader changed from 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66) to 56fedb1945204171a71642e6f845830d (127.1.155.65). New cstate: current_term: 3 leader_uuid: "56fedb1945204171a71642e6f845830d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: UNKNOWN } } }
I20260808 07:47:59.479493 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 07:47:59.684233 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 07:47:59.705178 1856 raft_consensus.cc:1240] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 3 LEADER]: Rejecting Update request from peer 1f6da230b0814f88915320b8ab2e69d6 for earlier term 2. Current term is 3. Ops: []
I20260808 07:47:59.707496 2096 consensus_queue.cc:1059] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:47:59.708904 2096 consensus_queue.cc:1243] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Peer 56fedb1945204171a71642e6f845830d log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260808 07:47:59.709478 2068 raft_consensus.cc:3055] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 07:47:59.710038 2068 raft_consensus.cc:740] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:47:59.711109 2068 consensus_queue.cc:260] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:47:59.712543 2068 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:47:59.909226 1972 raft_consensus.cc:1275] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 3 FOLLOWER]: Refusing update from remote peer 56fedb1945204171a71642e6f845830d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:47:59.912276 2105 consensus_queue.cc:1048] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260808 07:48:00.189973 1645 ts_tablet_manager-itest.cc:368] Electing peer 1...
I20260808 07:48:00.190258 1645 raft_consensus.cc:423] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 1 FOLLOWER]: Emulating election...
I20260808 07:48:00.190517 1645 raft_consensus.cc:3060] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:00.195215 1645 raft_consensus.cc:697] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 2 LEADER]: Becoming Leader. State: Replica: 56fedb1945204171a71642e6f845830d, State: Running, Role: LEADER
I20260808 07:48:00.195897 1645 consensus_queue.cc:237] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:48:00.200155 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:48:00.206624 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 07:48:00.207381 1693 catalog_manager.cc:5697] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d reported cstate change: term changed from 1 to 2, leader changed from 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66) to 56fedb1945204171a71642e6f845830d (127.1.155.65). New cstate: current_term: 2 leader_uuid: "56fedb1945204171a71642e6f845830d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:00.312919 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 07:48:00.386088 1856 raft_consensus.cc:1240] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 2 LEADER]: Rejecting Update request from peer 1f6da230b0814f88915320b8ab2e69d6 for earlier term 1. Current term is 2. Ops: []
I20260808 07:48:00.388371 2068 consensus_queue.cc:1059] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260808 07:48:00.391422 2068 consensus_queue.cc:1243] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Peer 56fedb1945204171a71642e6f845830d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260808 07:48:00.392132 2119 raft_consensus.cc:3055] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:00.392558 2119 raft_consensus.cc:740] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:48:00.393486 2119 consensus_queue.cc:260] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:48:00.394836 2119 raft_consensus.cc:3060] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:00.518272 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 07:48:00.660856 1972 raft_consensus.cc:1275] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 2 FOLLOWER]: Refusing update from remote peer 56fedb1945204171a71642e6f845830d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 07:48:00.662914 2105 consensus_queue.cc:1048] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260808 07:48:00.822893 1645 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 07:48:00.823151 1645 raft_consensus.cc:423] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 3 FOLLOWER]: Emulating election...
I20260808 07:48:00.823385 1645 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 3 FOLLOWER]: Advancing to term 4
I20260808 07:48:00.828040 1645 raft_consensus.cc:697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 4 LEADER]: Becoming Leader. State: Replica: 1f6da230b0814f88915320b8ab2e69d6, State: Running, Role: LEADER
I20260808 07:48:00.828718 1645 consensus_queue.cc:237] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:48:00.830133 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:48:00.833845 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 07:48:00.833608 1693 catalog_manager.cc:5697] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 reported cstate change: term changed from 3 to 4, leader changed from 56fedb1945204171a71642e6f845830d (127.1.155.65) to 1f6da230b0814f88915320b8ab2e69d6 (127.1.155.66). New cstate: current_term: 4 leader_uuid: "1f6da230b0814f88915320b8ab2e69d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } health_report { overall_health: HEALTHY } } }
I20260808 07:48:00.938397 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 07:48:01.087567 1972 raft_consensus.cc:1240] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 4 LEADER]: Rejecting Update request from peer 56fedb1945204171a71642e6f845830d for earlier term 3. Current term is 4. Ops: []
I20260808 07:48:01.088967 2122 consensus_queue.cc:1059] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 07:48:01.089552 2122 consensus_queue.cc:1243] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [LEADER]: Peer 1f6da230b0814f88915320b8ab2e69d6 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260808 07:48:01.089864 2105 raft_consensus.cc:3055] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 3 LEADER]: Stepping down as leader of term 3
I20260808 07:48:01.090124 2105 raft_consensus.cc:740] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56fedb1945204171a71642e6f845830d, State: Running, Role: LEADER
I20260808 07:48:01.090597 2105 consensus_queue.cc:260] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 } } peers { permanent_uuid: "1f6da230b0814f88915320b8ab2e69d6" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43581 } }
I20260808 07:48:01.091500 2105 raft_consensus.cc:3060] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 3 FOLLOWER]: Advancing to term 4
I20260808 07:48:01.142575 1645 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 07:48:01.420372 1856 raft_consensus.cc:1275] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 4 FOLLOWER]: Refusing update from remote peer 1f6da230b0814f88915320b8ab2e69d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260808 07:48:01.421860 2135 consensus_queue.cc:1048] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fedb1945204171a71642e6f845830d" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 07:48:01.648910 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:01.669734 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:01.670557 1645 tablet_replica.cc:333] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d: stopping tablet replica
I20260808 07:48:01.671150 1645 raft_consensus.cc:2243] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:01.671636 1645 raft_consensus.cc:2272] T 08777a554c294e6c97842871fe954c5e P 56fedb1945204171a71642e6f845830d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:01.674374 1645 tablet_replica.cc:333] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d: stopping tablet replica
I20260808 07:48:01.674825 1645 raft_consensus.cc:2243] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 2 LEADER]: Raft consensus shutting down.
I20260808 07:48:01.675371 1645 raft_consensus.cc:2272] T 1c734e3d84c243e0ab44a8a24a8e50fb P 56fedb1945204171a71642e6f845830d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:01.808175 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:01.818496 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:01.834232 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:01.834853 1645 tablet_replica.cc:333] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6: stopping tablet replica
I20260808 07:48:01.835366 1645 raft_consensus.cc:2243] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:01.835790 1645 raft_consensus.cc:2272] T 1c734e3d84c243e0ab44a8a24a8e50fb P 1f6da230b0814f88915320b8ab2e69d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:01.837234 1645 tablet_replica.cc:333] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6: stopping tablet replica
I20260808 07:48:01.837657 1645 raft_consensus.cc:2243] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 4 LEADER]: Raft consensus shutting down.
I20260808 07:48:01.838176 1645 raft_consensus.cc:2272] T 08777a554c294e6c97842871fe954c5e P 1f6da230b0814f88915320b8ab2e69d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:01.847019 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:01.856210 1645 master.cc:562] Master@127.1.155.126:44925 shutting down...
I20260808 07:48:01.949142 1778 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260808 07:48:02.154558 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:02.155121 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:02.155417 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 78db216e82854dd38daaebac22677474: stopping tablet replica
I20260808 07:48:02.173455 1645 master.cc:584] Master@127.1.155.126:44925 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (8306 ms)
[ RUN ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260808 07:48:02.199810 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:41249
I20260808 07:48:02.200886 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:02.205807 2153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.207046 2154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.209012 2156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.210335 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:02.211112 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:02.211293 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:02.211447 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175282211430 us; error 0 us; skew 500 ppm
I20260808 07:48:02.212122 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:02.214514 1645 webserver.cc:533] Webserver started at http://127.1.155.126:43683/ using document root <none> and password file <none>
I20260808 07:48:02.215023 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:02.215199 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:02.215487 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:02.216595 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "d8b937dce2b64b36b2109797321f4e76"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.221355 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 07:48:02.224979 2164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.225821 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:02.226128 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "d8b937dce2b64b36b2109797321f4e76"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.226423 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:02.237967 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:02.239017 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:02.274741 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:41249
I20260808 07:48:02.274827 2259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:41249 every 8 connection(s)
I20260808 07:48:02.278426 2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:02.287765 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76: Bootstrap starting.
I20260808 07:48:02.291800 2260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:02.295696 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76: No bootstrap required, opened a new log
I20260808 07:48:02.297811 2260 raft_consensus.cc:359] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER }
I20260808 07:48:02.298190 2260 raft_consensus.cc:385] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:02.298435 2260 raft_consensus.cc:740] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b937dce2b64b36b2109797321f4e76, State: Initialized, Role: FOLLOWER
I20260808 07:48:02.298965 2260 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER }
I20260808 07:48:02.299378 2260 raft_consensus.cc:399] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:02.299649 2260 raft_consensus.cc:493] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:02.299921 2260 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:02.303978 2260 raft_consensus.cc:515] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER }
I20260808 07:48:02.304507 2260 leader_election.cc:304] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8b937dce2b64b36b2109797321f4e76; no voters:
I20260808 07:48:02.305583 2260 leader_election.cc:290] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:02.305886 2265 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:02.307246 2265 raft_consensus.cc:697] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 1 LEADER]: Becoming Leader. State: Replica: d8b937dce2b64b36b2109797321f4e76, State: Running, Role: LEADER
I20260808 07:48:02.308034 2265 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER }
I20260808 07:48:02.308569 2260 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:02.310614 2267 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8b937dce2b64b36b2109797321f4e76. Latest consensus state: current_term: 1 leader_uuid: "d8b937dce2b64b36b2109797321f4e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER } }
I20260808 07:48:02.310631 2266 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8b937dce2b64b36b2109797321f4e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b937dce2b64b36b2109797321f4e76" member_type: VOTER } }
I20260808 07:48:02.311260 2267 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:02.311447 2266 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:02.316591 2272 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:02.322304 2272 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:02.323248 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:02.331019 2272 catalog_manager.cc:1383] Generated new cluster ID: 31a2e3f726d6435a99ec4273440003aa
I20260808 07:48:02.331348 2272 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:02.345317 2272 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:02.346582 2272 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:02.362576 2272 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76: Generated new TSK 0
I20260808 07:48:02.363209 2272 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:02.390302 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:02.395998 2297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.396718 2300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.398422 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:02.398375 2304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.399483 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:02.399680 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:02.399844 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175282399827 us; error 0 us; skew 500 ppm
I20260808 07:48:02.400331 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:02.402483 1645 webserver.cc:533] Webserver started at http://127.1.155.65:40341/ using document root <none> and password file <none>
I20260808 07:48:02.402949 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:02.403122 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:02.403373 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:02.404451 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "5ad16e9ee3064a228dff615d7bf85765"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.408879 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 07:48:02.412382 2311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.413133 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:02.413414 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "5ad16e9ee3064a228dff615d7bf85765"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.413666 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:02.426574 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:02.427662 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:02.429109 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:02.431289 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:02.431483 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.431710 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:02.431857 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.468317 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:45883
I20260808 07:48:02.468389 2423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:45883 every 8 connection(s)
I20260808 07:48:02.472890 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:02.479411 2428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.480507 2430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.482787 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:02.482986 2434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.483886 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:02.484082 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:02.484273 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175282484255 us; error 0 us; skew 500 ppm
I20260808 07:48:02.484727 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:02.487444 2424 heartbeater.cc:344] Connected to a master server at 127.1.155.126:41249
I20260808 07:48:02.487843 2424 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:02.488253 1645 webserver.cc:533] Webserver started at http://127.1.155.66:41371/ using document root <none> and password file <none>
I20260808 07:48:02.488658 2424 heartbeater.cc:507] Master 127.1.155.126:41249 requested a full tablet report, sending...
I20260808 07:48:02.488780 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:02.489010 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:02.489253 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:02.490588 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "a2f57f7bc0c9425a9e9fd81a2e024dd3"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.490779 2196 ts_manager.cc:194] Registered new tserver with Master: 5ad16e9ee3064a228dff615d7bf85765 (127.1.155.65:45883)
I20260808 07:48:02.492580 2196 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60636
I20260808 07:48:02.495688 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 07:48:02.499244 2441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.500025 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:02.500316 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "a2f57f7bc0c9425a9e9fd81a2e024dd3"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.500594 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:02.518138 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:02.519243 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:02.520674 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:02.522826 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:02.523026 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.523252 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:02.523398 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.584014 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:46173
I20260808 07:48:02.584337 2538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:46173 every 8 connection(s)
I20260808 07:48:02.595268 2424 heartbeater.cc:499] Master 127.1.155.126:41249 was elected leader, sending a full tablet report...
I20260808 07:48:02.610245 2539 heartbeater.cc:344] Connected to a master server at 127.1.155.126:41249
I20260808 07:48:02.610832 2539 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:02.612445 2539 heartbeater.cc:507] Master 127.1.155.126:41249 requested a full tablet report, sending...
I20260808 07:48:02.616006 2196 ts_manager.cc:194] Registered new tserver with Master: a2f57f7bc0c9425a9e9fd81a2e024dd3 (127.1.155.66:46173)
I20260808 07:48:02.616611 1645 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.026122859s
I20260808 07:48:02.618369 2196 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60650
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:422: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260808 07:48:02.658766 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:02.674319 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:02.690141 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:02.697376 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:02.713235 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:02.728703 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:02.735644 1645 master.cc:562] Master@127.1.155.126:41249 shutting down...
I20260808 07:48:02.749063 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:02.749552 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:02.749893 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P d8b937dce2b64b36b2109797321f4e76: stopping tablet replica
I20260808 07:48:02.768440 1645 master.cc:584] Master@127.1.155.126:41249 shutdown complete.
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (591 ms)
[ RUN ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260808 07:48:02.790772 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:37831
I20260808 07:48:02.792088 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:02.796880 2556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.798058 2558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.800922 2562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:02.801014 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:02.801878 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:02.802070 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:02.802239 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175282802219 us; error 0 us; skew 500 ppm
I20260808 07:48:02.802735 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:02.805171 1645 webserver.cc:533] Webserver started at http://127.1.155.126:40733/ using document root <none> and password file <none>
I20260808 07:48:02.805658 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:02.805836 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:02.806089 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:02.807147 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "6db2d867101848c387058d33b47a2689"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.811864 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 07:48:02.815371 2568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:02.816176 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260808 07:48:02.816465 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "6db2d867101848c387058d33b47a2689"
format_stamp: "Formatted at 2026-08-08 07:48:02 on dist-test-slave-pww0"
I20260808 07:48:02.816761 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:02.834132 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:02.835183 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:02.870982 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:37831
I20260808 07:48:02.871094 2655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:37831 every 8 connection(s)
I20260808 07:48:02.874730 2656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:02.884449 2656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689: Bootstrap starting.
I20260808 07:48:02.889442 2656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:02.893644 2656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689: No bootstrap required, opened a new log
I20260808 07:48:02.895696 2656 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER }
I20260808 07:48:02.896121 2656 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:02.896333 2656 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db2d867101848c387058d33b47a2689, State: Initialized, Role: FOLLOWER
I20260808 07:48:02.896914 2656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER }
I20260808 07:48:02.897405 2656 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:02.897629 2656 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:02.897891 2656 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:02.902247 2656 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER }
I20260808 07:48:02.902846 2656 leader_election.cc:304] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6db2d867101848c387058d33b47a2689; no voters:
I20260808 07:48:02.904021 2656 leader_election.cc:290] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:02.904314 2664 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:02.905606 2664 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 1 LEADER]: Becoming Leader. State: Replica: 6db2d867101848c387058d33b47a2689, State: Running, Role: LEADER
I20260808 07:48:02.906260 2664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER }
I20260808 07:48:02.906869 2656 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:02.909142 2665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6db2d867101848c387058d33b47a2689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER } }
I20260808 07:48:02.909163 2668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6db2d867101848c387058d33b47a2689. Latest consensus state: current_term: 1 leader_uuid: "6db2d867101848c387058d33b47a2689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db2d867101848c387058d33b47a2689" member_type: VOTER } }
I20260808 07:48:02.909904 2668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:02.910919 2665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:02.912906 2676 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:02.917635 2676 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:02.925349 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:02.926398 2676 catalog_manager.cc:1383] Generated new cluster ID: 7ef14bf5ac5b4c75921aecbfd78722e4
I20260808 07:48:02.926625 2676 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:02.961185 2676 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:02.962615 2676 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:02.981123 2676 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689: Generated new TSK 0
I20260808 07:48:02.981842 2676 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:02.991719 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:02.997653 2697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:02.998842 2698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:03.001192 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:03.001156 2700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:03.002435 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:03.002702 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:03.002888 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175283002870 us; error 0 us; skew 500 ppm
I20260808 07:48:03.003494 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:03.005770 1645 webserver.cc:533] Webserver started at http://127.1.155.65:34981/ using document root <none> and password file <none>
I20260808 07:48:03.006260 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:03.006438 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:03.006686 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:03.007833 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "89b4eca586924858b05fc5b17ef6c351"
format_stamp: "Formatted at 2026-08-08 07:48:03 on dist-test-slave-pww0"
I20260808 07:48:03.012527 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 07:48:03.016023 2707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.016805 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:03.017103 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "89b4eca586924858b05fc5b17ef6c351"
format_stamp: "Formatted at 2026-08-08 07:48:03 on dist-test-slave-pww0"
I20260808 07:48:03.017393 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:03.054373 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:03.055560 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:03.057034 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:03.059388 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:03.059624 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.059852 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:03.059998 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.096966 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:45371
I20260808 07:48:03.097065 2821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:45371 every 8 connection(s)
I20260808 07:48:03.101475 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:03.108011 2838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:03.110066 2839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:03.111892 2843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:03.113615 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:03.114115 2824 heartbeater.cc:344] Connected to a master server at 127.1.155.126:37831
I20260808 07:48:03.114498 2824 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:03.114522 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:03.114884 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:03.115077 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175283115057 us; error 0 us; skew 500 ppm
I20260808 07:48:03.115520 2824 heartbeater.cc:507] Master 127.1.155.126:37831 requested a full tablet report, sending...
I20260808 07:48:03.115826 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:03.117980 2598 ts_manager.cc:194] Registered new tserver with Master: 89b4eca586924858b05fc5b17ef6c351 (127.1.155.65:45371)
I20260808 07:48:03.120042 2598 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37042
I20260808 07:48:03.121331 1645 webserver.cc:533] Webserver started at http://127.1.155.66:35835/ using document root <none> and password file <none>
I20260808 07:48:03.121975 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:03.122217 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:03.122563 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:03.123660 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "3b218a726c754185ab5d5248d7907a1b"
format_stamp: "Formatted at 2026-08-08 07:48:03 on dist-test-slave-pww0"
I20260808 07:48:03.128418 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 07:48:03.137199 2850 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.138187 1645 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.002s sys 0.002s
I20260808 07:48:03.138617 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "3b218a726c754185ab5d5248d7907a1b"
format_stamp: "Formatted at 2026-08-08 07:48:03 on dist-test-slave-pww0"
I20260808 07:48:03.139019 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:03.162039 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:03.163033 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:03.164539 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:03.166739 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:03.166939 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.167147 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:03.167295 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:03.212643 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:43123
I20260808 07:48:03.212908 2949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:43123 every 8 connection(s)
I20260808 07:48:03.222927 2824 heartbeater.cc:499] Master 127.1.155.126:37831 was elected leader, sending a full tablet report...
I20260808 07:48:03.237399 2950 heartbeater.cc:344] Connected to a master server at 127.1.155.126:37831
I20260808 07:48:03.237753 2950 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:03.238463 2950 heartbeater.cc:507] Master 127.1.155.126:37831 requested a full tablet report, sending...
I20260808 07:48:03.241943 2598 ts_manager.cc:194] Registered new tserver with Master: 3b218a726c754185ab5d5248d7907a1b (127.1.155.66:43123)
I20260808 07:48:03.242525 1645 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.02390266s
I20260808 07:48:03.244269 2598 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37052
I20260808 07:48:03.283382 2598 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:48:03.286427 2598 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260808 07:48:03.348685 2950 heartbeater.cc:499] Master 127.1.155.126:37831 was elected leader, sending a full tablet report...
I20260808 07:48:03.353292 2896 tablet_service.cc:1511] Processing CreateTablet for tablet 101430915a33497082bf0ffa4c2cdd01 (DEFAULT_TABLE table=test-table [id=a6de7cde999f4ebc9604f9efe18ae27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:03.355765 2896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101430915a33497082bf0ffa4c2cdd01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:03.357991 2757 tablet_service.cc:1511] Processing CreateTablet for tablet 101430915a33497082bf0ffa4c2cdd01 (DEFAULT_TABLE table=test-table [id=a6de7cde999f4ebc9604f9efe18ae27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:03.359908 2757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101430915a33497082bf0ffa4c2cdd01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:03.379969 2970 tablet_bootstrap.cc:492] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: Bootstrap starting.
I20260808 07:48:03.381974 2971 tablet_bootstrap.cc:492] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: Bootstrap starting.
I20260808 07:48:03.386574 2970 tablet_bootstrap.cc:654] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:03.388274 2971 tablet_bootstrap.cc:654] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:03.391407 2970 tablet_bootstrap.cc:492] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: No bootstrap required, opened a new log
I20260808 07:48:03.391875 2970 ts_tablet_manager.cc:1403] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: Time spent bootstrapping tablet: real 0.012s user 0.012s sys 0.000s
I20260808 07:48:03.392776 2971 tablet_bootstrap.cc:492] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: No bootstrap required, opened a new log
I20260808 07:48:03.393216 2971 ts_tablet_manager.cc:1403] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260808 07:48:03.394469 2970 raft_consensus.cc:359] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:03.395100 2970 raft_consensus.cc:740] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b218a726c754185ab5d5248d7907a1b, State: Initialized, Role: FOLLOWER
I20260808 07:48:03.395759 2971 raft_consensus.cc:359] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:03.395678 2970 consensus_queue.cc:260] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:03.396346 2971 raft_consensus.cc:740] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Initialized, Role: FOLLOWER
I20260808 07:48:03.396973 2971 consensus_queue.cc:260] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:03.398116 2970 ts_tablet_manager.cc:1434] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 07:48:03.400287 2971 ts_tablet_manager.cc:1434] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260808 07:48:03.427824 1645 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 07:48:03.428032 1645 raft_consensus.cc:423] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 0 FOLLOWER]: Emulating election...
I20260808 07:48:03.428210 1645 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:03.432062 1645 raft_consensus.cc:697] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 1 LEADER]: Becoming Leader. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Running, Role: LEADER
W20260808 07:48:03.432487 2824 heartbeater.cc:646] Failed to heartbeat to 127.1.155.126:37831 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260808 07:48:03.432770 1645 consensus_queue.cc:237] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:03.434908 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:48:03.453661 1645 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 07:48:03.557981 1645 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 07:48:03.762455 1645 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 07:48:03.959544 2913 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:03.966873 2986 consensus_queue.cc:1048] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 07:48:04.069201 1645 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 07:48:04.069433 1645 raft_consensus.cc:423] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 1 LEADER]: Emulating election...
I20260808 07:48:04.069692 1645 raft_consensus.cc:3055] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:04.069909 1645 raft_consensus.cc:740] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Running, Role: LEADER
I20260808 07:48:04.070396 1645 consensus_queue.cc:260] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:04.071063 1645 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:04.075558 1645 raft_consensus.cc:697] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 2 LEADER]: Becoming Leader. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Running, Role: LEADER
I20260808 07:48:04.076117 1645 consensus_queue.cc:237] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:04.077512 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:48:04.081480 1645 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 07:48:04.186185 1645 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 07:48:04.390826 1645 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 07:48:04.518925 2913 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:04.523734 2913 raft_consensus.cc:1275] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 2 FOLLOWER]: Refusing update from remote peer 89b4eca586924858b05fc5b17ef6c351: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 07:48:04.525017 2986 consensus_queue.cc:1048] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 07:48:04.696471 1645 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 07:48:04.696727 1645 raft_consensus.cc:423] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 2 LEADER]: Emulating election...
I20260808 07:48:04.696902 1645 raft_consensus.cc:3055] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 07:48:04.697049 1645 raft_consensus.cc:740] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Running, Role: LEADER
I20260808 07:48:04.697458 1645 consensus_queue.cc:260] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:04.698045 1645 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:04.702361 1645 raft_consensus.cc:697] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 3 LEADER]: Becoming Leader. State: Replica: 89b4eca586924858b05fc5b17ef6c351, State: Running, Role: LEADER
I20260808 07:48:04.702970 1645 consensus_queue.cc:237] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 } } peers { permanent_uuid: "89b4eca586924858b05fc5b17ef6c351" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45371 } }
I20260808 07:48:04.704284 1645 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 07:48:04.708168 1645 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 07:48:04.812455 1645 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 07:48:05.016989 1645 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 07:48:05.218494 2913 raft_consensus.cc:3060] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:05.223567 2913 raft_consensus.cc:1275] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 3 FOLLOWER]: Refusing update from remote peer 89b4eca586924858b05fc5b17ef6c351: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:48:05.224967 3008 consensus_queue.cc:1048] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b218a726c754185ab5d5248d7907a1b" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 43123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:05.325488 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:05.345356 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:05.346117 1645 tablet_replica.cc:333] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351: stopping tablet replica
I20260808 07:48:05.346673 1645 raft_consensus.cc:2243] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 3 LEADER]: Raft consensus shutting down.
I20260808 07:48:05.347262 1645 raft_consensus.cc:2272] T 101430915a33497082bf0ffa4c2cdd01 P 89b4eca586924858b05fc5b17ef6c351 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:05.366423 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:05.375707 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:05.393172 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:05.393874 1645 tablet_replica.cc:333] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b: stopping tablet replica
I20260808 07:48:05.394367 1645 raft_consensus.cc:2243] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:05.394801 1645 raft_consensus.cc:2272] T 101430915a33497082bf0ffa4c2cdd01 P 3b218a726c754185ab5d5248d7907a1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:05.414283 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:05.423840 1645 master.cc:562] Master@127.1.155.126:37831 shutting down...
I20260808 07:48:05.442291 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:05.442842 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:05.443100 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6db2d867101848c387058d33b47a2689: stopping tablet replica
I20260808 07:48:05.460637 1645 master.cc:584] Master@127.1.155.126:37831 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2699 ms)
[----------] 3 tests from LeadershipChangeReportingTest (11598 ms total)
[----------] 4 tests from TsTabletManagerITest
[ RUN ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260808 07:48:05.491147 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:42457
I20260808 07:48:05.492357 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:05.497584 3021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.498443 3023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.499884 3028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:05.500154 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:05.501012 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:05.501209 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:05.501338 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175285501326 us; error 0 us; skew 500 ppm
I20260808 07:48:05.501786 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:05.504266 1645 webserver.cc:533] Webserver started at http://127.1.155.126:35581/ using document root <none> and password file <none>
I20260808 07:48:05.504709 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:05.504871 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:05.505095 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:05.506203 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "c5358225247d4e4aab533388f52c5fc6"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.510720 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:05.514041 3034 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.514745 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:05.514981 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "c5358225247d4e4aab533388f52c5fc6"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.515230 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:05.533331 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:05.534653 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:05.573241 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:42457
I20260808 07:48:05.573348 3110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:42457 every 8 connection(s)
I20260808 07:48:05.577214 3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:05.586760 3111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6: Bootstrap starting.
I20260808 07:48:05.591579 3111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:05.595657 3111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6: No bootstrap required, opened a new log
I20260808 07:48:05.597703 3111 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER }
I20260808 07:48:05.598086 3111 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:05.598260 3111 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5358225247d4e4aab533388f52c5fc6, State: Initialized, Role: FOLLOWER
I20260808 07:48:05.598790 3111 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER }
I20260808 07:48:05.599196 3111 raft_consensus.cc:399] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:05.599380 3111 raft_consensus.cc:493] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:05.599604 3111 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:05.603683 3111 raft_consensus.cc:515] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER }
I20260808 07:48:05.604146 3111 leader_election.cc:304] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5358225247d4e4aab533388f52c5fc6; no voters:
I20260808 07:48:05.605199 3111 leader_election.cc:290] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:05.605585 3114 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:05.606846 3114 raft_consensus.cc:697] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 1 LEADER]: Becoming Leader. State: Replica: c5358225247d4e4aab533388f52c5fc6, State: Running, Role: LEADER
I20260808 07:48:05.607569 3114 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER }
I20260808 07:48:05.608054 3111 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:05.610380 3115 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5358225247d4e4aab533388f52c5fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER } }
I20260808 07:48:05.610399 3116 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5358225247d4e4aab533388f52c5fc6. Latest consensus state: current_term: 1 leader_uuid: "c5358225247d4e4aab533388f52c5fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5358225247d4e4aab533388f52c5fc6" member_type: VOTER } }
I20260808 07:48:05.611109 3115 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:05.611155 3116 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:05.614841 3119 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:05.621968 3119 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:05.624341 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:05.630975 3119 catalog_manager.cc:1383] Generated new cluster ID: f80c3bb52ff5455e90896acf46efa1b6
I20260808 07:48:05.631276 3119 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:05.658674 3119 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:05.659970 3119 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:05.674494 3119 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6: Generated new TSK 0
I20260808 07:48:05.675068 3119 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:05.691180 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:05.697232 3143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.698365 3144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.699668 3150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:05.700112 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:05.700879 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:05.701056 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:05.701221 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175285701204 us; error 0 us; skew 500 ppm
I20260808 07:48:05.701761 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:05.704249 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43147/ using document root <none> and password file <none>
I20260808 07:48:05.704722 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:05.704890 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:05.705139 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:05.706271 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "7bdb6fc4dca144328465c84e618ef913"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.711118 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 07:48:05.714515 3158 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.715365 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:05.715706 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "7bdb6fc4dca144328465c84e618ef913"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.715979 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:05.728216 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:05.729416 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:05.730901 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:05.733302 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:05.733494 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.733721 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:05.733865 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.772797 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:32975
I20260808 07:48:05.772898 3246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:32975 every 8 connection(s)
I20260808 07:48:05.777429 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:05.784009 3255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.785939 3256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.786700 3259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:05.787314 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:05.788309 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:05.788551 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:05.788730 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175285788714 us; error 0 us; skew 500 ppm
I20260808 07:48:05.789301 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:05.790485 3247 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42457
I20260808 07:48:05.790858 3247 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:05.791558 3247 heartbeater.cc:507] Master 127.1.155.126:42457 requested a full tablet report, sending...
I20260808 07:48:05.791949 1645 webserver.cc:533] Webserver started at http://127.1.155.66:35241/ using document root <none> and password file <none>
I20260808 07:48:05.792462 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:05.792706 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:05.793030 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:05.793869 3059 ts_manager.cc:194] Registered new tserver with Master: 7bdb6fc4dca144328465c84e618ef913 (127.1.155.65:32975)
I20260808 07:48:05.794219 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.795591 3059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51630
I20260808 07:48:05.798844 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:05.802209 3267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.802959 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:05.803205 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.803440 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:05.815914 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:05.817106 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:05.818614 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:05.820895 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:05.821071 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.821276 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:05.821400 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.860200 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:40565
I20260808 07:48:05.860294 3367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:40565 every 8 connection(s)
I20260808 07:48:05.865062 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:05.872737 3375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:05.873132 3376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:05.876053 3368 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42457
I20260808 07:48:05.876468 3368 heartbeater.cc:461] Registering TS with master...
W20260808 07:48:05.877003 3383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:05.877154 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:05.877360 3368 heartbeater.cc:507] Master 127.1.155.126:42457 requested a full tablet report, sending...
I20260808 07:48:05.878295 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:05.878511 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:05.878706 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175285878687 us; error 0 us; skew 500 ppm
I20260808 07:48:05.879325 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:05.879598 3059 ts_manager.cc:194] Registered new tserver with Master: 0985a5bb0e9f4e0e82c72c359ea19a2a (127.1.155.66:40565)
I20260808 07:48:05.881108 3059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51642
I20260808 07:48:05.881830 1645 webserver.cc:533] Webserver started at http://127.1.155.67:37293/ using document root <none> and password file <none>
I20260808 07:48:05.882398 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:05.882581 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:05.882823 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:05.883936 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-2-root/instance:
uuid: "5d870e653d854d69acd641d7d8c66a87"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.888445 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 07:48:05.891768 3395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.892460 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 07:48:05.892724 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-2-root
uuid: "5d870e653d854d69acd641d7d8c66a87"
format_stamp: "Formatted at 2026-08-08 07:48:05 on dist-test-slave-pww0"
I20260808 07:48:05.892993 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786175273611720-1645-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:05.929564 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:05.930905 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:05.932417 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:05.934772 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:05.935042 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:05.935321 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:05.935564 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 07:48:06.008515 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.67:44633
I20260808 07:48:06.008585 3488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.67:44633 every 8 connection(s)
I20260808 07:48:06.024978 3489 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42457
I20260808 07:48:06.025346 3489 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:06.026105 3489 heartbeater.cc:507] Master 127.1.155.126:42457 requested a full tablet report, sending...
I20260808 07:48:06.028039 3059 ts_manager.cc:194] Registered new tserver with Master: 5d870e653d854d69acd641d7d8c66a87 (127.1.155.67:44633)
I20260808 07:48:06.028187 1645 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014409787s
I20260808 07:48:06.029757 3059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51650
I20260808 07:48:06.054908 3059 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260808 07:48:06.056483 3059 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:48:06.103302 3314 tablet_service.cc:1511] Processing CreateTablet for tablet 81aa1a16f00d458caa890171c3d4363b (DEFAULT_TABLE table=test-table [id=fc7d98bf0fc544f2b741f51a511d96c3]), partition=
I20260808 07:48:06.103847 3200 tablet_service.cc:1511] Processing CreateTablet for tablet 81aa1a16f00d458caa890171c3d4363b (DEFAULT_TABLE table=test-table [id=fc7d98bf0fc544f2b741f51a511d96c3]), partition=
I20260808 07:48:06.104493 3314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aa1a16f00d458caa890171c3d4363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:06.105002 3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aa1a16f00d458caa890171c3d4363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:06.106016 3432 tablet_service.cc:1511] Processing CreateTablet for tablet 81aa1a16f00d458caa890171c3d4363b (DEFAULT_TABLE table=test-table [id=fc7d98bf0fc544f2b741f51a511d96c3]), partition=
I20260808 07:48:06.107086 3432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aa1a16f00d458caa890171c3d4363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:06.118687 3507 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: Bootstrap starting.
I20260808 07:48:06.125733 3510 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: Bootstrap starting.
I20260808 07:48:06.125914 3507 tablet_bootstrap.cc:654] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:06.128373 3511 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: Bootstrap starting.
I20260808 07:48:06.131554 3507 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: No bootstrap required, opened a new log
I20260808 07:48:06.132035 3507 ts_tablet_manager.cc:1403] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260808 07:48:06.132411 3510 tablet_bootstrap.cc:654] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:06.135388 3511 tablet_bootstrap.cc:654] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:06.135003 3507 raft_consensus.cc:359] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.135826 3507 raft_consensus.cc:385] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:06.136145 3507 raft_consensus.cc:740] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0985a5bb0e9f4e0e82c72c359ea19a2a, State: Initialized, Role: FOLLOWER
I20260808 07:48:06.136937 3507 consensus_queue.cc:260] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.139703 3510 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: No bootstrap required, opened a new log
I20260808 07:48:06.140239 3510 ts_tablet_manager.cc:1403] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.002s
I20260808 07:48:06.140846 3507 ts_tablet_manager.cc:1434] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260808 07:48:06.142897 3368 heartbeater.cc:499] Master 127.1.155.126:42457 was elected leader, sending a full tablet report...
I20260808 07:48:06.143283 3510 raft_consensus.cc:359] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.144121 3510 raft_consensus.cc:385] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:06.144522 3510 raft_consensus.cc:740] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bdb6fc4dca144328465c84e618ef913, State: Initialized, Role: FOLLOWER
I20260808 07:48:06.145560 3510 consensus_queue.cc:260] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.146755 3511 tablet_bootstrap.cc:492] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: No bootstrap required, opened a new log
I20260808 07:48:06.147380 3511 ts_tablet_manager.cc:1403] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.000s
I20260808 07:48:06.149729 3510 ts_tablet_manager.cc:1434] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: Time spent starting tablet: real 0.009s user 0.003s sys 0.004s
I20260808 07:48:06.149283 3247 heartbeater.cc:499] Master 127.1.155.126:42457 was elected leader, sending a full tablet report...
I20260808 07:48:06.151341 3511 raft_consensus.cc:359] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.152042 3511 raft_consensus.cc:385] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:06.152343 3511 raft_consensus.cc:740] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d870e653d854d69acd641d7d8c66a87, State: Initialized, Role: FOLLOWER
I20260808 07:48:06.154227 3511 consensus_queue.cc:260] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.157307 3489 heartbeater.cc:499] Master 127.1.155.126:42457 was elected leader, sending a full tablet report...
I20260808 07:48:06.157925 3511 ts_tablet_manager.cc:1434] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20260808 07:48:06.296409 3514 raft_consensus.cc:493] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:06.296869 3514 raft_consensus.cc:515] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.299134 3514 leader_election.cc:290] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bdb6fc4dca144328465c84e618ef913 (127.1.155.65:32975), 5d870e653d854d69acd641d7d8c66a87 (127.1.155.67:44633)
I20260808 07:48:06.309005 3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aa1a16f00d458caa890171c3d4363b" candidate_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bdb6fc4dca144328465c84e618ef913" is_pre_election: true
I20260808 07:48:06.310035 3215 raft_consensus.cc:2468] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0985a5bb0e9f4e0e82c72c359ea19a2a in term 0.
I20260808 07:48:06.309906 3448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aa1a16f00d458caa890171c3d4363b" candidate_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d870e653d854d69acd641d7d8c66a87" is_pre_election: true
I20260808 07:48:06.310714 3448 raft_consensus.cc:2468] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0985a5bb0e9f4e0e82c72c359ea19a2a in term 0.
I20260808 07:48:06.311666 3269 leader_election.cc:304] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0985a5bb0e9f4e0e82c72c359ea19a2a, 7bdb6fc4dca144328465c84e618ef913; no voters:
I20260808 07:48:06.312569 3514 raft_consensus.cc:2804] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:06.312886 3514 raft_consensus.cc:493] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:06.313138 3514 raft_consensus.cc:3060] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:06.318008 3514 raft_consensus.cc:515] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.319748 3514 leader_election.cc:290] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [CANDIDATE]: Term 1 election: Requested vote from peers 7bdb6fc4dca144328465c84e618ef913 (127.1.155.65:32975), 5d870e653d854d69acd641d7d8c66a87 (127.1.155.67:44633)
I20260808 07:48:06.320647 3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aa1a16f00d458caa890171c3d4363b" candidate_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bdb6fc4dca144328465c84e618ef913"
I20260808 07:48:06.320848 3448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aa1a16f00d458caa890171c3d4363b" candidate_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d870e653d854d69acd641d7d8c66a87"
I20260808 07:48:06.321144 3215 raft_consensus.cc:3060] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:06.321362 3448 raft_consensus.cc:3060] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:06.326268 3215 raft_consensus.cc:2468] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0985a5bb0e9f4e0e82c72c359ea19a2a in term 1.
I20260808 07:48:06.326265 3448 raft_consensus.cc:2468] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0985a5bb0e9f4e0e82c72c359ea19a2a in term 1.
I20260808 07:48:06.327549 3269 leader_election.cc:304] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0985a5bb0e9f4e0e82c72c359ea19a2a, 7bdb6fc4dca144328465c84e618ef913; no voters:
I20260808 07:48:06.328219 3514 raft_consensus.cc:2804] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:06.329154 3514 raft_consensus.cc:697] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 1 LEADER]: Becoming Leader. State: Replica: 0985a5bb0e9f4e0e82c72c359ea19a2a, State: Running, Role: LEADER
I20260808 07:48:06.329804 3514 consensus_queue.cc:237] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } }
I20260808 07:48:06.336629 3059 catalog_manager.cc:5697] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0985a5bb0e9f4e0e82c72c359ea19a2a (127.1.155.66). New cstate: current_term: 1 leader_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0985a5bb0e9f4e0e82c72c359ea19a2a" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:06.870064 3526 consensus_queue.cc:1048] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bdb6fc4dca144328465c84e618ef913" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:48:06.882026 3536 consensus_queue.cc:1048] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d870e653d854d69acd641d7d8c66a87" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 44633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:48:07.402496 1645 tablet_replica.cc:333] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913: stopping tablet replica
I20260808 07:48:07.403065 1645 raft_consensus.cc:2243] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:07.403553 1645 raft_consensus.cc:2272] T 81aa1a16f00d458caa890171c3d4363b P 7bdb6fc4dca144328465c84e618ef913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:07.890113 3269 consensus_queue.cc:579] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [LEADER]: The tablet replica hosted on peer 7bdb6fc4dca144328465c84e618ef913 has failed
W20260808 07:48:07.890673 3269 consensus_peers.cc:597] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a -> Peer 7bdb6fc4dca144328465c84e618ef913 (127.1.155.65:32975): Couldn't send request to peer 7bdb6fc4dca144328465c84e618ef913. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:07.928345 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:07.945981 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:07.963835 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:07.972179 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:07.986155 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:07.986737 1645 tablet_replica.cc:333] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a: stopping tablet replica
I20260808 07:48:07.987222 1645 raft_consensus.cc:2243] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:07.987980 1645 raft_consensus.cc:2272] T 81aa1a16f00d458caa890171c3d4363b P 0985a5bb0e9f4e0e82c72c359ea19a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:08.005772 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:08.014017 1645 tablet_server.cc:179] TabletServer@127.1.155.67:0 shutting down...
I20260808 07:48:08.029887 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:08.030503 1645 tablet_replica.cc:333] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87: stopping tablet replica
I20260808 07:48:08.030992 1645 raft_consensus.cc:2243] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:08.031396 1645 raft_consensus.cc:2272] T 81aa1a16f00d458caa890171c3d4363b P 5d870e653d854d69acd641d7d8c66a87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:08.049137 1645 tablet_server.cc:196] TabletServer@127.1.155.67:0 shutdown complete.
I20260808 07:48:08.057186 1645 master.cc:562] Master@127.1.155.126:42457 shutting down...
I20260808 07:48:08.070901 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:08.071414 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:08.071768 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P c5358225247d4e4aab533388f52c5fc6: stopping tablet replica
I20260808 07:48:08.088719 1645 master.cc:584] Master@127.1.155.126:42457 shutdown complete.
[ OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (2622 ms)
[ RUN ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260808 07:48:08.113749 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:37971
I20260808 07:48:08.115018 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:08.119917 3554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.120783 3557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.122622 3559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.123024 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:08.123948 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.124123 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.124285 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288124267 us; error 0 us; skew 500 ppm
I20260808 07:48:08.124867 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.127211 1645 webserver.cc:533] Webserver started at http://127.1.155.126:39469/ using document root <none> and password file <none>
I20260808 07:48:08.127754 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.127936 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:08.128190 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:08.129249 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.134052 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 07:48:08.137466 3569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.138222 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:08.138509 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.138783 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.159644 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.160703 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.197178 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:37971
I20260808 07:48:08.197292 3653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:37971 every 8 connection(s)
I20260808 07:48:08.201020 3655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:08.210866 3655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda: Bootstrap starting.
I20260808 07:48:08.215178 3655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:08.219165 3655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda: No bootstrap required, opened a new log
I20260808 07:48:08.221213 3655 raft_consensus.cc:359] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER }
I20260808 07:48:08.221647 3655 raft_consensus.cc:385] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:08.221870 3655 raft_consensus.cc:740] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb29fdd6f9e14e7c86da5147d3b4ceda, State: Initialized, Role: FOLLOWER
I20260808 07:48:08.222404 3655 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER }
I20260808 07:48:08.222879 3655 raft_consensus.cc:399] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:08.223099 3655 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:08.223340 3655 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:08.227738 3655 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER }
I20260808 07:48:08.228274 3655 leader_election.cc:304] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb29fdd6f9e14e7c86da5147d3b4ceda; no voters:
I20260808 07:48:08.229383 3655 leader_election.cc:290] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:08.229744 3659 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:08.231016 3659 raft_consensus.cc:697] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 1 LEADER]: Becoming Leader. State: Replica: cb29fdd6f9e14e7c86da5147d3b4ceda, State: Running, Role: LEADER
I20260808 07:48:08.231724 3659 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER }
I20260808 07:48:08.232270 3655 sys_catalog.cc:565] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:08.234364 3662 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb29fdd6f9e14e7c86da5147d3b4ceda. Latest consensus state: current_term: 1 leader_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER } }
I20260808 07:48:08.234357 3660 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb29fdd6f9e14e7c86da5147d3b4ceda" member_type: VOTER } }
I20260808 07:48:08.235040 3662 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:08.235195 3660 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:08.238402 3667 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:08.245580 3667 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:08.246557 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:08.254496 3667 catalog_manager.cc:1383] Generated new cluster ID: 31958d01b22e493b8b71ea2104f55923
I20260808 07:48:08.254755 3667 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:08.274109 3667 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:08.275370 3667 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:08.292339 3667 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda: Generated new TSK 0
I20260808 07:48:08.292973 3667 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:08.313678 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:08.319752 3684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.321065 3685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.321974 3687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.322264 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:08.323127 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.323323 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.323498 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288323452 us; error 0 us; skew 500 ppm
I20260808 07:48:08.324002 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.326205 1645 webserver.cc:533] Webserver started at http://127.1.155.65:41197/ using document root <none> and password file <none>
I20260808 07:48:08.326691 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.326875 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:08.327147 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:08.328294 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "0dc25f59ccd846c8970a06ff6a7a93b8"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.333082 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 07:48:08.336576 3695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.337404 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260808 07:48:08.337666 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "0dc25f59ccd846c8970a06ff6a7a93b8"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.337927 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.352246 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.353353 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.354809 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:08.357152 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:08.357347 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.357583 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:08.357738 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.394510 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:32825
I20260808 07:48:08.394600 3796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:32825 every 8 connection(s)
I20260808 07:48:08.412242 3797 heartbeater.cc:344] Connected to a master server at 127.1.155.126:37971
I20260808 07:48:08.412629 3797 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:08.413316 3797 heartbeater.cc:507] Master 127.1.155.126:37971 requested a full tablet report, sending...
I20260808 07:48:08.415280 3603 ts_manager.cc:194] Registered new tserver with Master: 0dc25f59ccd846c8970a06ff6a7a93b8 (127.1.155.65:32825)
I20260808 07:48:08.415989 1645 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.018377773s
I20260808 07:48:08.417016 3603 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52584
I20260808 07:48:08.436242 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:08.449961 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:08.465369 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:08.473147 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 07:48:08.475997 1645 tablet_server.cc:94] deduplicated master addresses: 127.1.155.126:37971
W20260808 07:48:08.478907 3813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.480345 3814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.480584 3816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.481096 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:08.481889 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.482064 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.482221 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288482204 us; error 0 us; skew 500 ppm
I20260808 07:48:08.482713 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.485003 1645 webserver.cc:533] Webserver started at http://127.1.155.65:41197/ using document root <none> and password file <none>
I20260808 07:48:08.485478 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.485631 1645 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 07:48:08.489339 1645 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 07:48:08.492244 3823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.492995 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:08.493295 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "0dc25f59ccd846c8970a06ff6a7a93b8"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.493558 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.505488 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.506563 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.508003 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:08.510295 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:08.510504 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.510722 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:08.510850 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.549275 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:32825
I20260808 07:48:08.549362 3921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:32825 every 8 connection(s)
I20260808 07:48:08.556069 1645 tablet_server.cc:179] TabletServer@127.1.155.65:32825 shutting down...
I20260808 07:48:08.569258 3925 heartbeater.cc:344] Connected to a master server at 127.1.155.126:37971
I20260808 07:48:08.569780 3925 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:08.570559 3925 heartbeater.cc:507] Master 127.1.155.126:37971 requested a full tablet report, sending...
I20260808 07:48:08.572763 3603 ts_manager.cc:194] Re-registered known tserver with Master: 0dc25f59ccd846c8970a06ff6a7a93b8 (127.1.155.65:32825)
I20260808 07:48:08.575129 3603 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52606
I20260808 07:48:08.577665 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:08.592952 1645 tablet_server.cc:196] TabletServer@127.1.155.65:32825 shutdown complete.
I20260808 07:48:08.600716 1645 master.cc:562] Master@127.1.155.126:37971 shutting down...
I20260808 07:48:08.614986 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:08.615547 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:08.616030 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P cb29fdd6f9e14e7c86da5147d3b4ceda: stopping tablet replica
I20260808 07:48:08.634446 1645 master.cc:584] Master@127.1.155.126:37971 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (543 ms)
[ RUN ] TsTabletManagerITest.TestTableStats
I20260808 07:48:08.657284 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:35639,127.1.155.125:42215,127.1.155.124:35685
I20260808 07:48:08.658820 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:08.663619 3937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.664599 3940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.666416 3943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.666792 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:08.667568 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.667737 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.667889 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288667871 us; error 0 us; skew 500 ppm
I20260808 07:48:08.668397 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.670802 1645 webserver.cc:533] Webserver started at http://127.1.155.126:36599/ using document root <none> and password file <none>
I20260808 07:48:08.671296 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.671499 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:08.671790 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:08.672878 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "c2708100e6a4418886fd1ebea2971042"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.677325 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 07:48:08.680792 3951 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.681514 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:48:08.681855 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "c2708100e6a4418886fd1ebea2971042"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.682133 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.697330 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.698382 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.733393 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:35639
I20260808 07:48:08.733489 4028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:35639 every 8 connection(s)
I20260808 07:48:08.737449 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 07:48:08.737751 4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 07:48:08.742725 4037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:08.745671 4041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.746182 4029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } has no permanent_uuid. Determining permanent_uuid...
W20260808 07:48:08.747658 4047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.750195 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:08.751181 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.751489 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.751685 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288751667 us; error 0 us; skew 500 ppm
I20260808 07:48:08.752269 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.755106 1645 webserver.cc:533] Webserver started at http://127.1.155.125:35497/ using document root <none> and password file <none>
I20260808 07:48:08.755755 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.755985 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:08.756294 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:08.757543 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-1-root/instance:
uuid: "0192cfedca3a451da732c9648d519cc9"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.762487 4029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.763278 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
W20260808 07:48:08.764870 3954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.155.125:42215: connect: Connection refused (error 111)
I20260808 07:48:08.767022 4061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.767897 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 07:48:08.768227 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-1-root
uuid: "0192cfedca3a451da732c9648d519cc9"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
W20260808 07:48:08.768263 4029 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.155.125:42215: Network error: Client connection negotiation failed: client connection to 127.1.155.125:42215: connect: Connection refused (error 111)
I20260808 07:48:08.768533 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.778149 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.779156 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.814100 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.125:42215
I20260808 07:48:08.814191 4139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.125:42215 every 8 connection(s)
I20260808 07:48:08.817844 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 07:48:08.818017 4142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:08.819823 4029 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } attempt: 1
W20260808 07:48:08.824057 4144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.827245 4142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } has no permanent_uuid. Determining permanent_uuid...
W20260808 07:48:08.834829 4145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.836422 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:08.836902 4149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:08.837896 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:08.838156 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:08.838362 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175288838342 us; error 0 us; skew 500 ppm
I20260808 07:48:08.838881 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:08.839640 4029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.841723 1645 webserver.cc:533] Webserver started at http://127.1.155.124:40293/ using document root <none> and password file <none>
I20260808 07:48:08.842208 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:08.842394 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:08.842640 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:08.843881 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-2-root/instance:
uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
W20260808 07:48:08.845319 4029 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.155.124:35685: Network error: Client connection negotiation failed: client connection to 127.1.155.124:35685: connect: Connection refused (error 111)
I20260808 07:48:08.847833 4142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.849231 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 07:48:08.852937 4157 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:08.853724 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:48:08.854058 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-2-root
uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
format_stamp: "Formatted at 2026-08-08 07:48:08 on dist-test-slave-pww0"
I20260808 07:48:08.854468 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:08.859923 4142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } has no permanent_uuid. Determining permanent_uuid...
W20260808 07:48:08.865187 4142 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.155.124:35685: Network error: Client connection negotiation failed: client connection to 127.1.155.124:35685: connect: Connection refused (error 111)
I20260808 07:48:08.877182 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:08.878275 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:08.883735 4142 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } attempt: 1
W20260808 07:48:08.888720 4142 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.155.124:35685: Network error: Client connection negotiation failed: client connection to 127.1.155.124:35685: connect: Connection refused (error 111)
I20260808 07:48:08.890793 4029 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } attempt: 1
W20260808 07:48:08.896175 4029 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.155.124:35685: Network error: Client connection negotiation failed: client connection to 127.1.155.124:35685: connect: Connection refused (error 111)
I20260808 07:48:08.916774 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.124:35685
I20260808 07:48:08.916867 4248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.124:35685 every 8 connection(s)
I20260808 07:48:08.919723 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:08.920435 4249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:08.925994 4249 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.936510 4249 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.936687 4029 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } attempt: 2
I20260808 07:48:08.943260 4142 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } attempt: 2
I20260808 07:48:08.948385 4249 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:48:08.959286 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: Bootstrap starting.
I20260808 07:48:08.963829 4029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:08.966070 4142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: Bootstrap starting.
I20260808 07:48:08.967696 4249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: Bootstrap starting.
I20260808 07:48:08.968235 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: No bootstrap required, opened a new log
I20260808 07:48:08.970517 4029 raft_consensus.cc:359] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.971076 4029 raft_consensus.cc:385] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:08.971321 4029 raft_consensus.cc:740] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2708100e6a4418886fd1ebea2971042, State: Initialized, Role: FOLLOWER
I20260808 07:48:08.972036 4029 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.972573 4142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:08.973974 4249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:08.974519 4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:08.975569 4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:08.976375 4029 sys_catalog.cc:565] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:08.978534 4142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: No bootstrap required, opened a new log
I20260808 07:48:08.979678 4249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: No bootstrap required, opened a new log
I20260808 07:48:08.981333 4142 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.982059 4142 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:08.982365 4142 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0192cfedca3a451da732c9648d519cc9, State: Initialized, Role: FOLLOWER
I20260808 07:48:08.982457 4249 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.983191 4249 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:08.983175 4142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.983723 4249 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c3870a6c8b4f2cabb86bdd081560ab, State: Initialized, Role: FOLLOWER
I20260808 07:48:08.984756 4249 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:08.985948 4273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:08.986887 4273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:08.987627 4142 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:08.988541 4275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:08.989388 4275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:08.990105 4249 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:08.994907 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260808 07:48:08.999902 4289 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:48:09.000376 4289 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:48:09.011576 4257 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:09.012156 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260808 07:48:09.012161 4257 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:09.014264 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 07:48:09.014627 4257 leader_election.cc:290] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:09.015311 4273 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260808 07:48:09.015636 4311 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:48:09.015939 4311 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:48:09.015805 4273 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
E20260808 07:48:09.016786 1645 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260808 07:48:09.017442 4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:09.017705 4273 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:09.018102 4107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 0.
I20260808 07:48:09.018473 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:09.019145 3993 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0192cfedca3a451da732c9648d519cc9 in term 0.
I20260808 07:48:09.019171 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:09.019345 4204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:09.020071 4205 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 0.
I20260808 07:48:09.020761 3954 leader_election.cc:304] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042; no voters:
I20260808 07:48:09.021610 4257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:09.021977 4257 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:09.022279 4068 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042; no voters: c8c3870a6c8b4f2cabb86bdd081560ab
I20260808 07:48:09.022485 4257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:48:09.022694 4312 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:48:09.023042 4312 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:48:09.023509 4273 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:09.023880 4273 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:09.024225 4273 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:48:09.026146 4314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:09.028031 4315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.030803 4257 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:09.033171 4257 leader_election.cc:290] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 1 election: Requested vote from peers 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:09.033500 4273 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:09.034535 4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9"
I20260808 07:48:09.034947 4204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
I20260808 07:48:09.035385 4107 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c2708100e6a4418886fd1ebea2971042 in current term 1: Already voted for candidate 0192cfedca3a451da732c9648d519cc9 in this term.
I20260808 07:48:09.035545 4204 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:09.036310 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042"
I20260808 07:48:09.037026 3993 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0192cfedca3a451da732c9648d519cc9 in current term 1: Already voted for candidate c2708100e6a4418886fd1ebea2971042 in this term.
I20260808 07:48:09.038559 4273 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 1 election: Requested vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:09.039193 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
I20260808 07:48:09.041285 4067 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9; no voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab
I20260808 07:48:09.042258 4273 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 07:48:09.043031 4204 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 1.
I20260808 07:48:09.044173 3954 leader_election.cc:304] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9
I20260808 07:48:09.044669 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:09.045298 4257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 FOLLOWER]: Leader election won for term 1
W20260808 07:48:09.045317 4318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.046299 4257 raft_consensus.cc:697] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 LEADER]: Becoming Leader. State: Replica: c2708100e6a4418886fd1ebea2971042, State: Running, Role: LEADER
I20260808 07:48:09.046571 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:09.046830 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:09.047022 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175289047005 us; error 0 us; skew 500 ppm
I20260808 07:48:09.047165 4257 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:09.047843 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:09.051126 1645 webserver.cc:533] Webserver started at http://127.1.155.65:35657/ using document root <none> and password file <none>
I20260808 07:48:09.051672 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:09.051903 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:09.051479 4319 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.052193 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:09.052155 4319 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:09.053789 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "da534ee7656240ba82544d75f334f1c5"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.053938 4324 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:09.059085 4324 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:09.059118 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 07:48:09.063181 4327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.064086 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 07:48:09.064448 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "da534ee7656240ba82544d75f334f1c5"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.064817 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:09.068148 4204 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Refusing update from remote peer c2708100e6a4418886fd1ebea2971042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:48:09.068432 4107 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Refusing update from remote peer c2708100e6a4418886fd1ebea2971042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:48:09.070263 4257 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:48:09.071040 4319 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:48:09.087337 4273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.088151 4273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:09.089637 4275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.090363 4275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:09.090426 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:09.090796 4328 mvcc.cc:204] Tried to move back new op lower bound from 7316173984009175040 to 7316173983947358208. Current Snapshot: MvccSnapshot[applied={T|T < 7316173984009175040}]
I20260808 07:48:09.092682 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:09.101420 4275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.102180 4275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:09.104749 4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.105800 4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:09.106454 4324 catalog_manager.cc:1383] Generated new cluster ID: 04c255ccfc1a482b89e32563c771dc40
I20260808 07:48:09.106879 4324 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:09.106559 4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.107378 4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:09.108366 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:09.110317 4273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:09.111011 4273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:09.113071 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:09.113304 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.113510 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:09.113633 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.137761 4324 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:09.139798 4324 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:09.171818 4324 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: Generated new TSK 0
I20260808 07:48:09.172528 4324 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:09.184064 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:38009
I20260808 07:48:09.184290 4447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:38009 every 8 connection(s)
I20260808 07:48:09.202095 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 07:48:09.205684 1645 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260808 07:48:09.206928 4449 heartbeater.cc:344] Connected to a master server at 127.1.155.124:35685
I20260808 07:48:09.207338 4449 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.208304 4449 heartbeater.cc:507] Master 127.1.155.124:35685 requested a full tablet report, sending...
I20260808 07:48:09.210029 4451 heartbeater.cc:344] Connected to a master server at 127.1.155.126:35639
I20260808 07:48:09.210492 4451 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.211490 4451 heartbeater.cc:507] Master 127.1.155.126:35639 requested a full tablet report, sending...
I20260808 07:48:09.211599 4187 ts_manager.cc:194] Registered new tserver with Master: da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:09.214527 3979 ts_manager.cc:194] Registered new tserver with Master: da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:09.215271 4450 heartbeater.cc:344] Connected to a master server at 127.1.155.125:42215
I20260808 07:48:09.215685 4450 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.216645 4450 heartbeater.cc:507] Master 127.1.155.125:42215 requested a full tablet report, sending...
I20260808 07:48:09.217523 3979 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53564
W20260808 07:48:09.218923 4460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:09.218502 4458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.221215 4089 ts_manager.cc:194] Registered new tserver with Master: da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:09.225543 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:09.226318 4464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.227236 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:09.227495 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:09.227666 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175289227653 us; error 0 us; skew 500 ppm
I20260808 07:48:09.228143 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:09.230592 1645 webserver.cc:533] Webserver started at http://127.1.155.66:41491/ using document root <none> and password file <none>
I20260808 07:48:09.231036 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:09.231196 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:09.231418 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:09.232518 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "16ba713c60a44ec9a988b586f3d877c7"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.238303 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 07:48:09.242199 4469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.243340 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 07:48:09.243783 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "16ba713c60a44ec9a988b586f3d877c7"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.244185 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:09.277410 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:09.280238 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:09.281687 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:09.289299 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:09.289527 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.289816 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:09.290015 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.322393 4451 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:09.534965 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:38763
I20260808 07:48:09.535425 4566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:38763 every 8 connection(s)
I20260808 07:48:09.585773 4567 heartbeater.cc:344] Connected to a master server at 127.1.155.124:35685
I20260808 07:48:09.586499 4567 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.588091 4567 heartbeater.cc:507] Master 127.1.155.124:35685 requested a full tablet report, sending...
I20260808 07:48:09.600466 4187 ts_manager.cc:194] Registered new tserver with Master: 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:09.607331 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 07:48:09.610165 1645 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260808 07:48:09.616962 4572 heartbeater.cc:344] Connected to a master server at 127.1.155.126:35639
I20260808 07:48:09.617933 4572 heartbeater.cc:461] Registering TS with master...
W20260808 07:48:09.619752 4577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.619545 4572 heartbeater.cc:507] Master 127.1.155.126:35639 requested a full tablet report, sending...
I20260808 07:48:09.624336 3979 ts_manager.cc:194] Registered new tserver with Master: 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:09.624601 4568 heartbeater.cc:344] Connected to a master server at 127.1.155.125:42215
I20260808 07:48:09.625155 4568 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.626922 4568 heartbeater.cc:507] Master 127.1.155.125:42215 requested a full tablet report, sending...
I20260808 07:48:09.627368 3979 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53578
W20260808 07:48:09.628922 4578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.633898 4089 ts_manager.cc:194] Registered new tserver with Master: 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
W20260808 07:48:09.640049 4583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:09.640301 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:09.641685 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:09.641927 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:09.642112 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175289642095 us; error 0 us; skew 500 ppm
I20260808 07:48:09.642714 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:09.646111 1645 webserver.cc:533] Webserver started at http://127.1.155.67:35771/ using document root <none> and password file <none>
I20260808 07:48:09.646812 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:09.647074 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:09.647398 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:09.648546 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-2-root/instance:
uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.653127 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 07:48:09.657140 4590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.658092 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 07:48:09.658438 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-2-root
uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
format_stamp: "Formatted at 2026-08-08 07:48:09 on dist-test-slave-pww0"
I20260808 07:48:09.658833 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:09.684437 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:09.685901 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:09.687214 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:09.689472 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:09.689675 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.689901 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:09.690040 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:09.732198 4572 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:09.902626 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.67:42315
I20260808 07:48:09.902729 4691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.67:42315 every 8 connection(s)
I20260808 07:48:09.969381 4694 heartbeater.cc:344] Connected to a master server at 127.1.155.124:35685
I20260808 07:48:09.969969 4694 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.971649 4694 heartbeater.cc:507] Master 127.1.155.124:35685 requested a full tablet report, sending...
I20260808 07:48:09.974323 4700 heartbeater.cc:344] Connected to a master server at 127.1.155.126:35639
I20260808 07:48:09.974888 4700 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.976001 4187 ts_manager.cc:194] Registered new tserver with Master: 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:09.976519 4700 heartbeater.cc:507] Master 127.1.155.126:35639 requested a full tablet report, sending...
I20260808 07:48:09.976994 4695 heartbeater.cc:344] Connected to a master server at 127.1.155.125:42215
I20260808 07:48:09.977552 4695 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:09.979383 4695 heartbeater.cc:507] Master 127.1.155.125:42215 requested a full tablet report, sending...
I20260808 07:48:09.979784 3979 ts_manager.cc:194] Registered new tserver with Master: 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:09.982052 3979 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53580
I20260808 07:48:09.983155 4089 ts_manager.cc:194] Registered new tserver with Master: 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:09.984180 1645 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.031979352s
I20260808 07:48:10.022933 4311 catalog_manager.cc:1295] Loaded cluster ID: 04c255ccfc1a482b89e32563c771dc40
I20260808 07:48:10.023343 4311 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: loading cluster ID for follower catalog manager: success
I20260808 07:48:10.031811 4312 catalog_manager.cc:1295] Loaded cluster ID: 04c255ccfc1a482b89e32563c771dc40
I20260808 07:48:10.032582 4312 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: loading cluster ID for follower catalog manager: success
I20260808 07:48:10.047771 4312 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: acquiring CA information for follower catalog manager: success
I20260808 07:48:10.053146 4311 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: acquiring CA information for follower catalog manager: success
I20260808 07:48:10.063686 4312 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:48:10.071965 4311 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:48:10.089175 4700 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:10.098608 3977 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260808 07:48:10.102015 3977 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:48:10.346424 4636 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9c1c3d182346a3a3069a73eb4a940a (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.347695 4635 tablet_service.cc:1511] Processing CreateTablet for tablet e086226ad6974dbf974c0bb4418b9f00 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.350200 4634 tablet_service.cc:1511] Processing CreateTablet for tablet af0e77d8fd4340beb9f9cee089cbc9d1 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.353725 4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9c1c3d182346a3a3069a73eb4a940a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.354799 4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e086226ad6974dbf974c0bb4418b9f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.356454 4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0e77d8fd4340beb9f9cee089cbc9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.377151 4394 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9c1c3d182346a3a3069a73eb4a940a (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.378468 4393 tablet_service.cc:1511] Processing CreateTablet for tablet e086226ad6974dbf974c0bb4418b9f00 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.390184 4517 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9c1c3d182346a3a3069a73eb4a940a (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.392273 4514 tablet_service.cc:1511] Processing CreateTablet for tablet af0e77d8fd4340beb9f9cee089cbc9d1 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.393443 4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9c1c3d182346a3a3069a73eb4a940a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.389293 4516 tablet_service.cc:1511] Processing CreateTablet for tablet e086226ad6974dbf974c0bb4418b9f00 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.390089 4391 tablet_service.cc:1511] Processing CreateTablet for tablet af0e77d8fd4340beb9f9cee089cbc9d1 (DEFAULT_TABLE table=test-table [id=2dad415b2056494eb9165bc9d136f4c0]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:10.401525 4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e086226ad6974dbf974c0bb4418b9f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.404798 4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0e77d8fd4340beb9f9cee089cbc9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.406242 4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e086226ad6974dbf974c0bb4418b9f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.407548 4517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9c1c3d182346a3a3069a73eb4a940a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.412451 4514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0e77d8fd4340beb9f9cee089cbc9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:10.487775 4742 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:10.488788 4742 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:10.507404 4742 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:10.510057 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:10.512274 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:10.516430 4746 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: Bootstrap starting.
I20260808 07:48:10.519743 4067 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9; no voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab
I20260808 07:48:10.522954 4742 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:10.528632 4743 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Bootstrap starting.
I20260808 07:48:10.533037 4744 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Bootstrap starting.
I20260808 07:48:10.547978 4743 tablet_bootstrap.cc:654] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.549955 4744 tablet_bootstrap.cc:654] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.550091 4746 tablet_bootstrap.cc:654] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.558516 4743 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: No bootstrap required, opened a new log
I20260808 07:48:10.560654 4743 ts_tablet_manager.cc:1403] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent bootstrapping tablet: real 0.034s user 0.017s sys 0.008s
I20260808 07:48:10.567301 4743 raft_consensus.cc:359] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.569271 4743 raft_consensus.cc:385] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:10.569741 4743 raft_consensus.cc:740] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Initialized, Role: FOLLOWER
I20260808 07:48:10.572574 4743 consensus_queue.cc:260] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.574344 4746 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: No bootstrap required, opened a new log
I20260808 07:48:10.575292 4746 ts_tablet_manager.cc:1403] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.020s
I20260808 07:48:10.581687 4746 raft_consensus.cc:359] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.582589 4746 raft_consensus.cc:385] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:10.582960 4746 raft_consensus.cc:740] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Initialized, Role: FOLLOWER
I20260808 07:48:10.584043 4746 consensus_queue.cc:260] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.590095 4743 ts_tablet_manager.cc:1434] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent starting tablet: real 0.029s user 0.008s sys 0.010s
I20260808 07:48:10.591981 4743 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Bootstrap starting.
I20260808 07:48:10.623847 4744 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: No bootstrap required, opened a new log
I20260808 07:48:10.626829 4744 ts_tablet_manager.cc:1403] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Time spent bootstrapping tablet: real 0.097s user 0.018s sys 0.015s
I20260808 07:48:10.633378 4743 tablet_bootstrap.cc:654] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.635587 4757 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:10.636492 4757 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.633443 4746 ts_tablet_manager.cc:1434] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: Time spent starting tablet: real 0.058s user 0.015s sys 0.023s
I20260808 07:48:10.649345 4757 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:10.663986 4744 raft_consensus.cc:359] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.665154 4744 raft_consensus.cc:385] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:10.665685 4744 raft_consensus.cc:740] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Initialized, Role: FOLLOWER
I20260808 07:48:10.667630 4746 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: Bootstrap starting.
I20260808 07:48:10.669338 4744 consensus_queue.cc:260] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.672870 4752 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:10.673538 4752 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.678848 4744 ts_tablet_manager.cc:1434] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Time spent starting tablet: real 0.051s user 0.008s sys 0.008s
I20260808 07:48:10.680775 4743 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: No bootstrap required, opened a new log
I20260808 07:48:10.681610 4743 ts_tablet_manager.cc:1403] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent bootstrapping tablet: real 0.090s user 0.019s sys 0.025s
I20260808 07:48:10.684324 4744 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: Bootstrap starting.
I20260808 07:48:10.817723 4752 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:10.825753 4746 tablet_bootstrap.cc:654] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.839689 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
W20260808 07:48:10.846527 4472 leader_election.cc:343] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:10.841167 4743 raft_consensus.cc:359] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.847556 4743 raft_consensus.cc:385] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:10.853834 4744 tablet_bootstrap.cc:654] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.848366 4743 raft_consensus.cc:740] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Initialized, Role: FOLLOWER
I20260808 07:48:10.853328 4766 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:10.856838 4743 consensus_queue.cc:260] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.863813 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:10.866330 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:10.868635 4743 ts_tablet_manager.cc:1434] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent starting tablet: real 0.187s user 0.005s sys 0.011s
I20260808 07:48:10.871610 4743 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: Bootstrap starting.
I20260808 07:48:10.864569 4766 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
W20260808 07:48:10.872053 4591 leader_election.cc:343] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:10.874439 4408 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 0.
I20260808 07:48:10.880405 4473 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:10.883549 4757 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:10.884002 4757 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:10.884563 4757 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:10.879961 4752 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:10.899096 4752 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:10.909552 4766 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:10.926240 4752 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:10.926050 4757 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:10.928047 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:10.930405 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
W20260808 07:48:10.930891 4591 leader_election.cc:343] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763): Illegal state: must be running to vote when last-logged opid is not known
W20260808 07:48:10.934901 4472 leader_election.cc:343] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:10.936173 4757 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Requested vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:10.940405 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:10.941354 4408 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:10.956554 4743 tablet_bootstrap.cc:654] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:10.962790 4746 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: No bootstrap required, opened a new log
I20260808 07:48:10.963632 4746 ts_tablet_manager.cc:1403] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: Time spent bootstrapping tablet: real 0.319s user 0.024s sys 0.013s
I20260808 07:48:10.976187 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:10.980643 4408 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 1.
I20260808 07:48:11.013599 4744 tablet_bootstrap.cc:492] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: No bootstrap required, opened a new log
I20260808 07:48:11.014410 4744 ts_tablet_manager.cc:1403] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: Time spent bootstrapping tablet: real 0.330s user 0.024s sys 0.013s
I20260808 07:48:11.015591 4746 raft_consensus.cc:359] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.016788 4746 raft_consensus.cc:385] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260808 07:48:11.017119 4595 leader_election.cc:343] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:11.017351 4746 raft_consensus.cc:740] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Initialized, Role: FOLLOWER
I20260808 07:48:11.018812 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:11.018930 4473 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:11.020905 4595 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:11.022243 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:11.022341 4746 consensus_queue.cc:260] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.023141 4752 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 07:48:11.023715 4757 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Leader election won for term 1
W20260808 07:48:11.027815 4338 leader_election.cc:343] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:11.030102 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
W20260808 07:48:11.034034 4595 leader_election.cc:343] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:11.034987 4595 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:11.044400 4752 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 07:48:11.035126 4746 ts_tablet_manager.cc:1434] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: Time spent starting tablet: real 0.071s user 0.007s sys 0.007s
I20260808 07:48:11.049696 4746 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: Bootstrap starting.
I20260808 07:48:11.052763 4757 raft_consensus.cc:697] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Becoming Leader. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Running, Role: LEADER
I20260808 07:48:11.055428 4757 consensus_queue.cc:237] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:11.059192 4743 tablet_bootstrap.cc:492] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: No bootstrap required, opened a new log
I20260808 07:48:11.059867 4743 ts_tablet_manager.cc:1403] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent bootstrapping tablet: real 0.190s user 0.006s sys 0.021s
I20260808 07:48:11.038029 4744 raft_consensus.cc:359] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.060359 4744 raft_consensus.cc:385] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:11.060736 4744 raft_consensus.cc:740] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Initialized, Role: FOLLOWER
I20260808 07:48:11.061498 4746 tablet_bootstrap.cc:654] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:11.061489 4744 consensus_queue.cc:260] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.068470 4743 raft_consensus.cc:359] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:11.069280 4743 raft_consensus.cc:385] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:11.069598 4743 raft_consensus.cc:740] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Initialized, Role: FOLLOWER
I20260808 07:48:11.071316 4743 consensus_queue.cc:260] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:11.074013 4743 ts_tablet_manager.cc:1434] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: Time spent starting tablet: real 0.014s user 0.005s sys 0.004s
I20260808 07:48:11.083962 4744 ts_tablet_manager.cc:1434] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: Time spent starting tablet: real 0.069s user 0.011s sys 0.003s
I20260808 07:48:11.106472 4766 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:11.107192 4744 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Bootstrap starting.
I20260808 07:48:11.107360 4337 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:11.106977 4766 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.109737 4763 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 07:48:11.109957 4766 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:11.112068 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:11.112722 4651 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 0.
I20260808 07:48:11.113965 4338 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:11.116129 4766 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:11.116587 4746 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: No bootstrap required, opened a new log
I20260808 07:48:11.115536 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:11.117663 4529 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 0.
I20260808 07:48:11.117136 4746 ts_tablet_manager.cc:1403] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.034s
I20260808 07:48:11.120148 3979 catalog_manager.cc:5697] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66). New cstate: current_term: 1 leader_uuid: "16ba713c60a44ec9a988b586f3d877c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:11.116578 4766 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:11.124691 4766 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.133455 4746 raft_consensus.cc:359] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.134346 4746 raft_consensus.cc:385] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:11.134656 4746 raft_consensus.cc:740] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Initialized, Role: FOLLOWER
I20260808 07:48:11.135239 4766 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.142554 4766 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:11.139969 4744 tablet_bootstrap.cc:654] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:11.136721 4746 consensus_queue.cc:260] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.144305 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:11.145354 4529 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.146937 4746 ts_tablet_manager.cc:1434] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: Time spent starting tablet: real 0.027s user 0.007s sys 0.013s
I20260808 07:48:11.142354 4651 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.152611 4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:11.164574 4650 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.181723 4757 consensus_queue.cc:1048] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 07:48:11.200780 4757 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:11.201795 4757 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.210470 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:11.212217 4649 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 0.
I20260808 07:48:11.217165 4472 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters:
I20260808 07:48:11.215164 4529 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 1.
I20260808 07:48:11.225945 4783 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:11.227717 4783 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:11.228497 4783 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.232710 4337 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:11.234490 4766 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:11.235316 4766 raft_consensus.cc:697] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 LEADER]: Becoming Leader. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:11.230731 4650 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 1.
I20260808 07:48:11.237249 4766 consensus_queue.cc:237] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.220682 4757 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:11.245152 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
W20260808 07:48:11.275564 4473 leader_election.cc:343] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:11.283268 4752 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:11.283875 4752 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:11.287133 4757 consensus_queue.cc:1048] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260808 07:48:11.302939 4752 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:11.305913 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:11.304804 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:11.312989 4595 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:11.318168 4744 tablet_bootstrap.cc:492] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: No bootstrap required, opened a new log
I20260808 07:48:11.319096 4744 ts_tablet_manager.cc:1403] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Time spent bootstrapping tablet: real 0.214s user 0.008s sys 0.024s
I20260808 07:48:11.321501 4783 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.337594 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:11.338780 4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:11.339933 4650 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:48:11.344333 4473 leader_election.cc:343] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260808 07:48:11.346767 4783 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:11.384351 4744 raft_consensus.cc:359] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
W20260808 07:48:11.412041 4790 log.cc:927] Time spent T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Append to log took a long time: real 0.113s user 0.000s sys 0.001s
I20260808 07:48:11.425203 4650 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 1.
I20260808 07:48:11.427518 4744 raft_consensus.cc:385] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:11.431691 4744 raft_consensus.cc:740] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Initialized, Role: FOLLOWER
I20260808 07:48:11.433091 4744 consensus_queue.cc:260] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.433984 4472 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:11.435876 4783 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:11.436369 4783 raft_consensus.cc:697] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Becoming Leader. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Running, Role: LEADER
I20260808 07:48:11.436998 4783 consensus_queue.cc:237] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.444482 4752 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:11.464243 4766 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:11.465078 4766 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:11.473960 4763 consensus_queue.cc:1048] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 07:48:11.505686 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:11.525874 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:11.526822 4649 raft_consensus.cc:2393] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 1: Already voted for candidate 16ba713c60a44ec9a988b586f3d877c7 in this term.
I20260808 07:48:11.528420 4338 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:11.530108 4763 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:11.533866 4766 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
W20260808 07:48:11.565378 4473 consensus_peers.cc:597] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 -> Peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Couldn't send request to peer da534ee7656240ba82544d75f334f1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:11.613618 4811 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:11.614307 4811 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:11.628000 4744 ts_tablet_manager.cc:1434] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Time spent starting tablet: real 0.308s user 0.004s sys 0.033s
I20260808 07:48:11.627252 4763 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 07:48:11.615955 4821 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:11.636401 4821 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:11.650671 4821 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:11.652993 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:11.653169 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:11.657992 4205 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0192cfedca3a451da732c9648d519cc9 in term 1.
I20260808 07:48:11.663167 4067 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9, c8c3870a6c8b4f2cabb86bdd081560ab; no voters: c2708100e6a4418886fd1ebea2971042
I20260808 07:48:11.675057 4821 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:11.688431 4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:11.675731 4821 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:11.689549 4821 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:11.698367 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:11.711017 4163 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:11.710479 4821 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:11.709528 4811 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:11.724257 4811 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:11.726821 3977 catalog_manager.cc:5697] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to da534ee7656240ba82544d75f334f1c5 (127.1.155.65). New cstate: current_term: 1 leader_uuid: "da534ee7656240ba82544d75f334f1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } }
I20260808 07:48:11.734479 3977 catalog_manager.cc:5697] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66). New cstate: current_term: 1 leader_uuid: "16ba713c60a44ec9a988b586f3d877c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260808 07:48:11.766371 4107 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Rejecting Update request from peer c2708100e6a4418886fd1ebea2971042 for earlier term 1. Current term is 2. Ops: [1.8-1.8]
I20260808 07:48:11.770692 4725 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 }, Status: INVALID_TERM, Last received: 1.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260808 07:48:11.780805 4796 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:11.781466 4796 raft_consensus.cc:740] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2708100e6a4418886fd1ebea2971042, State: Running, Role: LEADER
I20260808 07:48:11.790596 4796 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:11.803083 4821 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 election: Requested vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:11.804510 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
W20260808 07:48:11.808993 4163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.155.126:35639, user_credentials={real_user=slave}} blocked reactor thread for 98151.3us
I20260808 07:48:11.816344 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042"
I20260808 07:48:11.816877 4796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:11.836369 3993 raft_consensus.cc:2410] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0192cfedca3a451da732c9648d519cc9 for term 2 because replica has last-logged OpId of term: 1 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 7.
I20260808 07:48:11.840931 4068 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9; no voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab
W20260808 07:48:11.840891 4709 master_proxy_rpc.cc:203] Re-attempting IsCreateTableDone request to leader Master (127.1.155.126:35639)
I20260808 07:48:11.842968 4821 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:48:12.013379 4838 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:12.014530 4796 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:12.014267 4838 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.015311 4796 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.018011 4838 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:12.018919 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:12.019368 4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 3 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:12.020195 4796 leader_election.cc:290] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:12.020527 4107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 2.
I20260808 07:48:12.020206 3993 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c3870a6c8b4f2cabb86bdd081560ab in term 2.
I20260808 07:48:12.021219 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 3 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:12.021971 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:12.023397 4102 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8c3870a6c8b4f2cabb86bdd081560ab in current term 2: Already voted for candidate 0192cfedca3a451da732c9648d519cc9 in this term.
I20260808 07:48:12.022989 3954 leader_election.cc:304] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042; no voters:
I20260808 07:48:12.022225 4205 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 1.
I20260808 07:48:12.023665 4163 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab; no voters:
I20260808 07:48:12.025091 4796 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 07:48:12.025264 4838 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:12.026759 4838 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:12.027544 4838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:12.025744 4796 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:12.028396 4796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:12.041594 4796 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.041723 4838 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.046662 4838 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 election: Requested vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:12.048887 4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9"
I20260808 07:48:12.050403 4107 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c8c3870a6c8b4f2cabb86bdd081560ab in current term 2: Already voted for candidate 0192cfedca3a451da732c9648d519cc9 in this term.
I20260808 07:48:12.050683 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 3 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9"
I20260808 07:48:12.051644 4102 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:12.052587 4796 leader_election.cc:290] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 3 election: Requested vote from peers 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:12.048933 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042"
I20260808 07:48:12.055015 3993 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c8c3870a6c8b4f2cabb86bdd081560ab for earlier term 2. Current term is 3.
I20260808 07:48:12.058431 4163 leader_election.cc:400] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 election: Vote denied by peer c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c8c3870a6c8b4f2cabb86bdd081560ab for earlier term 2. Current term is 3.
I20260808 07:48:12.058951 4163 leader_election.cc:403] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260808 07:48:12.060822 4838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:12.060920 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2708100e6a4418886fd1ebea2971042" candidate_term: 3 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab"
I20260808 07:48:12.071184 4838 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c8c3870a6c8b4f2cabb86bdd081560ab for earlier term 2. Current term is 3.
I20260808 07:48:12.072507 4102 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 3.
I20260808 07:48:12.074326 3954 leader_election.cc:304] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042; no voters:
I20260808 07:48:12.087891 4796 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:48:12.088872 4796 raft_consensus.cc:697] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 LEADER]: Becoming Leader. State: Replica: c2708100e6a4418886fd1ebea2971042, State: Running, Role: LEADER
I20260808 07:48:12.090615 4796 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.103534 4205 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2708100e6a4418886fd1ebea2971042 in term 3.
I20260808 07:48:12.105347 4725 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.106911 4725 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:12.121281 4841 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:12.131915 4841 catalog_manager.cc:679] Loaded metadata for table test-table [id=2dad415b2056494eb9165bc9d136f4c0]
I20260808 07:48:12.141954 4841 tablet_loader.cc:96] loaded metadata for tablet 0c9c1c3d182346a3a3069a73eb4a940a (table test-table [id=2dad415b2056494eb9165bc9d136f4c0])
I20260808 07:48:12.144250 4841 tablet_loader.cc:96] loaded metadata for tablet af0e77d8fd4340beb9f9cee089cbc9d1 (table test-table [id=2dad415b2056494eb9165bc9d136f4c0])
I20260808 07:48:12.145884 4841 tablet_loader.cc:96] loaded metadata for tablet e086226ad6974dbf974c0bb4418b9f00 (table test-table [id=2dad415b2056494eb9165bc9d136f4c0])
I20260808 07:48:12.148445 4841 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:12.154698 4841 catalog_manager.cc:1295] Loaded cluster ID: 04c255ccfc1a482b89e32563c771dc40
I20260808 07:48:12.155197 4841 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:12.165393 4841 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:12.170878 4841 catalog_manager.cc:6081] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: Loaded TSK: 0
I20260808 07:48:12.172183 4841 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:12.185212 4205 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Refusing update from remote peer c2708100e6a4418886fd1ebea2971042: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260808 07:48:12.187143 4725 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 07:48:12.194440 4838 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.195621 4838 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:12.198873 4839 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.200078 4839 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:12.202723 4102 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Refusing update from remote peer c2708100e6a4418886fd1ebea2971042: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260808 07:48:12.204226 4838 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.205293 4838 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:12.205340 4839 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260808 07:48:12.236500 4572 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:12.300302 4821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2708100e6a4418886fd1ebea2971042. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.301281 4821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:12.304921 4839 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.307264 4839 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:12.345955 4700 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:12.350188 4845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c2708100e6a4418886fd1ebea2971042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } } }
I20260808 07:48:12.354208 4451 heartbeater.cc:499] Master 127.1.155.126:35639 was elected leader, sending a full tablet report...
I20260808 07:48:12.351389 4845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:48:12.400789 4838 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:12.401707 4838 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.406383 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:12.409377 4838 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:12.415760 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:12.424093 4162 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:12.432111 4838 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:12.816938 4838 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:12.817586 4838 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:12.840422 4838 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:12.920326 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:12.924012 4884 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:12.924662 4884 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:12.923939 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:12.934803 4884 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:12.935956 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:12.938424 4884 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:12.939262 4884 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:12.943033 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:12.943753 4162 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:12.945964 4838 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:12.945631 4884 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:12.948167 4591 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:12.949496 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:12.952310 4888 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:12.952659 4884 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:12.953249 4888 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:12.960554 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:12.978783 4595 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:12.982435 4884 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:12.985466 4888 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:12.985949 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:13.003985 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:13.024122 4591 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:13.026588 4884 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.498076 4930 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:20.501827 4906 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:20.529392 4936 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:20.539852 4935 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:20.547775 4920 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:20.502542 4929 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:20.559023 4929 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:20.558600 4920 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:20.555483 4906 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:20.571848 4930 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:20.557196 4936 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:20.580668 4932 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:20.579159 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:20.589793 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:20.598352 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:20.590931 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:20.606087 4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:20.605993 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:20.587450 4906 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:20.593695 4920 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:20.615090 4936 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:20.594939 4940 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:20.596275 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:20.613956 4338 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:20.580295 4935 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:20.619410 4204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:20.618424 4940 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:20.627069 4920 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.629792 4338 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:20.636000 4941 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.624933 4067 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9; no voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab
I20260808 07:48:20.633466 4935 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:20.636157 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:20.639289 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:20.643225 4936 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:20.634799 4473 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:20.646133 4911 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.649283 4595 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:20.650141 4930 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:20.653051 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:20.582857 4932 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:20.653292 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:20.599318 4929 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:20.654930 4935 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.660429 4940 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:20.664134 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:20.660893 4932 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:20.666684 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:20.662026 4162 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:20.664733 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:20.662786 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:20.670204 4930 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:20.671972 4595 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:20.673508 4932 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:20.674957 4595 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:20.676761 4940 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.742327 3969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53578 (request call id 101) took 1258 ms. Trace:
I20260808 07:48:22.742985 3969 rpcz_store.cc:276] 0808 07:48:21.483807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 07:48:22.740773 (+1256966us) service_pool.cc:224] Handling call
0808 07:48:22.742239 (+ 1466us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260808 07:48:22.816215 4949 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:22.817019 4949 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:22.819155 4949 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:22.821655 4949 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:22.823884 4949 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:22.829892 4949 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:22.837833 4942 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:22.838505 4942 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:22.841586 4942 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:22.841895 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:22.845083 4947 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:22.846616 4947 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:22.847682 4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:22.848443 4647 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 1.
I20260808 07:48:22.845741 4184 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60348 (request call id 107) took 1534 ms. Trace:
I20260808 07:48:22.849844 4184 rpcz_store.cc:276] 0808 07:48:21.311538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 07:48:21.312507 (+ 969us) service_pool.cc:224] Handling call
0808 07:48:22.845652 (+1533145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 07:48:22.850454 4472 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:22.851601 4942 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:22.844277 4957 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:22.852005 4942 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:22.852216 4957 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:22.854246 4942 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:22.857254 4957 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:22.858105 4957 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:22.858922 4957 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:22.859875 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:22.864991 4957 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:22.867759 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:22.862948 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:22.871135 4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:22.872406 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:22.862995 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:22.874136 4591 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:22.877555 4591 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:22.877774 4957 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.877832 4942 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:22.879118 4957 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.880842 4527 raft_consensus.cc:1240] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 1. Current term is 2. Ops: []
I20260808 07:48:22.880961 4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:22.883416 4942 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:22.883924 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:22.884507 4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:22.884811 4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:22.886195 4338 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:22.887138 4953 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.887692 4338 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:22.888482 4949 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.889567 4472 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:22.890254 4942 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:48:22.891726 4947 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
I20260808 07:48:22.892714 4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "0192cfedca3a451da732c9648d519cc9" is_pre_election: true
I20260808 07:48:22.892714 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:22.894915 4162 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:22.895599 4947 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:22.896735 4949 consensus_queue.cc:1059] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:22.897832 4953 raft_consensus.cc:3055] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:22.898272 4953 raft_consensus.cc:740] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:22.899263 4953 consensus_queue.cc:260] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:22.901479 4953 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:23.084856 4957 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:23.085075 4953 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:23.085832 4957 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:23.085956 4953 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:23.092114 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:23.092092 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:23.092909 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:23.093358 4527 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 2.
I20260808 07:48:23.094074 4406 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 2.
I20260808 07:48:23.096777 4957 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:23.097113 4953 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:23.096571 4337 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:23.098249 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:23.098616 4953 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 07:48:23.099258 4649 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 1.
I20260808 07:48:23.099499 4595 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7
I20260808 07:48:23.099315 4953 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:23.101976 4953 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:23.103533 4957 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:23.104326 4957 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:23.105046 4957 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:23.115793 4953 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:23.119190 4953 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:23.120313 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:23.121260 4529 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:23.124432 4957 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:23.129966 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:23.130779 4957 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:23.131453 4406 raft_consensus.cc:2368] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 for earlier term 2. Current term is 3.
I20260808 07:48:23.133610 4595 leader_election.cc:400] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Vote denied by peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009) with higher term. Message: Invalid argument: T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 for earlier term 2. Current term is 3.
I20260808 07:48:23.134171 4595 leader_election.cc:403] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260808 07:48:23.135152 4957 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:23.139185 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:23.140604 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:23.145385 4529 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 3.
I20260808 07:48:23.147322 4337 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:23.148717 4957 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009) with higher term. Message: Invalid argument: T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 for earlier term 2. Current term is 3.
I20260808 07:48:23.148874 4953 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:48:23.149868 4953 raft_consensus.cc:697] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 LEADER]: Becoming Leader. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:23.151643 4953 consensus_queue.cc:237] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:23.164618 4649 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 3.
I20260808 07:48:23.174971 3969 catalog_manager.cc:5697] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "da534ee7656240ba82544d75f334f1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:23.241358 4649 raft_consensus.cc:1275] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Refusing update from remote peer da534ee7656240ba82544d75f334f1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:48:23.243901 4953 consensus_queue.cc:1048] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:23.272043 4529 raft_consensus.cc:1275] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Refusing update from remote peer da534ee7656240ba82544d75f334f1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:48:23.276518 4953 consensus_queue.cc:1048] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260808 07:48:23.632431 4687 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc320 after lost signal to thread 1648
W20260808 07:48:23.633908 4687 debug-util.cc:398] Leaking SignalData structure 0x7b08001516e0 after lost signal to thread 4028
W20260808 07:48:23.635193 4687 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff060 after lost signal to thread 4139
W20260808 07:48:23.636369 4687 debug-util.cc:398] Leaking SignalData structure 0x7b0800036480 after lost signal to thread 4248
W20260808 07:48:23.638437 4687 debug-util.cc:398] Leaking SignalData structure 0x7b0800239700 after lost signal to thread 4447
W20260808 07:48:23.640125 4687 debug-util.cc:398] Leaking SignalData structure 0x7b08002172c0 after lost signal to thread 4566
W20260808 07:48:23.641793 4687 debug-util.cc:398] Leaking SignalData structure 0x7b0800128700 after lost signal to thread 4691
I20260808 07:48:28.220814 4992 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:28.222340 4992 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.226395 5001 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:28.227412 5001 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.230767 4992 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.235152 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:28.255237 4649 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 3.
I20260808 07:48:28.236567 5001 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.237777 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.299383 5004 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:28.474483 4529 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 3.
I20260808 07:48:28.474562 5004 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
W20260808 07:48:28.475399 4529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53284 (request call id 13) took 238 ms (client timeout 268 ms). Trace:
I20260808 07:48:28.452477 4472 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters:
W20260808 07:48:28.476383 4529 rpcz_store.cc:269] 0808 07:48:28.236720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 07:48:28.236930 (+ 210us) service_pool.cc:224] Handling call
0808 07:48:28.475199 (+238269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 07:48:28.479784 4591 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters:
I20260808 07:48:28.480777 4996 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.471329 5001 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.480053 5002 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 07:48:28.490424 5002 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:28.491421 5002 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Advancing to term 4
I20260808 07:48:28.463999 5012 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.487251 5001 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.508217 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.508810 5001 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.509598 5001 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 07:48:28.510030 5001 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da534ee7656240ba82544d75f334f1c5)
I20260808 07:48:28.481604 4996 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.517313 5001 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Advancing to term 4
I20260808 07:48:28.517776 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.533531 4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 10 } } ignore_live_leader: false dest_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" is_pre_election: true
I20260808 07:48:28.518430 5012 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.522852 5002 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.523478 3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0192cfedca3a451da732c9648d519cc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 10 } } ignore_live_leader: false dest_uuid: "c2708100e6a4418886fd1ebea2971042" is_pre_election: true
I20260808 07:48:28.545960 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.525722 5004 leader_election.cc:290] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), c8c3870a6c8b4f2cabb86bdd081560ab (127.1.155.124:35685)
I20260808 07:48:28.546793 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.549062 4527 raft_consensus.cc:1240] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 4 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 3. Current term is 4. Ops: []
I20260808 07:48:28.549419 5014 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.550132 5014 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.551286 5012 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.550732 4996 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.554867 5002 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 4 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.556944 4068 leader_election.cc:304] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0192cfedca3a451da732c9648d519cc9; no voters: c2708100e6a4418886fd1ebea2971042, c8c3870a6c8b4f2cabb86bdd081560ab
I20260808 07:48:28.558569 5004 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:28.560068 5014 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:28.562135 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.564798 4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:28.566591 4646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:28.569591 4338 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.570835 4996 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:28.574095 5001 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.575491 4649 raft_consensus.cc:1240] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 3. Current term is 4. Ops: []
I20260808 07:48:28.576803 5001 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 4 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.578125 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.580722 4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
W20260808 07:48:28.582954 4595 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.155.65:38009 timed out after 0.268s (SENT) [suppressed 5 similar messages]
I20260808 07:48:28.583189 4338 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.584641 4996 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:48:28.587625 4996 consensus_queue.cc:1059] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260808 07:48:28.588943 4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.589661 4406 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 1.
I20260808 07:48:28.589758 4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.590380 4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.591333 4996 raft_consensus.cc:3055] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260808 07:48:28.592023 4996 raft_consensus.cc:740] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:28.593451 4996 consensus_queue.cc:260] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.590984 4405 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 1.
I20260808 07:48:28.595974 4996 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260808 07:48:28.596092 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.603148 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.605254 4595 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7
I20260808 07:48:28.606395 5001 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:28.606699 4595 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.606985 5001 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.607726 5001 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.608336 4595 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7
I20260808 07:48:28.608531 4473 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.610656 4942 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260808 07:48:28.612219 5014 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260808 07:48:28.613479 5014 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:28.614140 5014 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.614934 5014 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.623623 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.624404 4404 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 4.
I20260808 07:48:28.629361 5001 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.630568 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "16ba713c60a44ec9a988b586f3d877c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.631211 4404 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ba713c60a44ec9a988b586f3d877c7 in term 4.
I20260808 07:48:28.632066 5001 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.632768 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.629377 5014 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.633682 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.635555 4591 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.636518 5001 raft_consensus.cc:2749] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:48:28.637779 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.638109 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.636453 5014 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:28.640003 4591 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.641160 5014 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:48:28.660112 4649 raft_consensus.cc:1240] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Rejecting Update request from peer 16ba713c60a44ec9a988b586f3d877c7 for earlier term 1. Current term is 2. Ops: []
I20260808 07:48:28.661505 4942 consensus_queue.cc:1059] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:28.662420 4992 raft_consensus.cc:3055] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:28.662936 4992 raft_consensus.cc:740] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Running, Role: LEADER
I20260808 07:48:28.664477 4992 consensus_queue.cc:260] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.666168 4992 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.687364 4649 raft_consensus.cc:1240] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Rejecting Update request from peer 16ba713c60a44ec9a988b586f3d877c7 for earlier term 1. Current term is 2. Ops: []
I20260808 07:48:28.688853 4992 consensus_queue.cc:1059] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:28.690366 4942 raft_consensus.cc:3055] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 07:48:28.690665 4942 raft_consensus.cc:740] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16ba713c60a44ec9a988b586f3d877c7, State: Running, Role: LEADER
I20260808 07:48:28.691402 4942 consensus_queue.cc:260] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.692627 4942 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.795962 4996 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.796931 4996 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.799974 4996 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.800797 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.801020 5016 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.801410 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:28.802201 4649 raft_consensus.cc:2393] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 2: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.801759 4527 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 2.
I20260808 07:48:28.801872 5016 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.804258 4337 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.804956 4996 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:28.805572 4996 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.806090 5016 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.806103 4996 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.806542 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:28.807420 4649 raft_consensus.cc:2393] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 2: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.807737 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.808626 4527 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 2.
I20260808 07:48:28.810425 4337 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.811951 5016 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:48:28.815281 5016 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16ba713c60a44ec9a988b586f3d877c7)
I20260808 07:48:28.816033 5016 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:28.818571 4996 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.821812 4996 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.822760 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.823443 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:28.824226 4649 raft_consensus.cc:2393] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 2: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.828694 5016 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.832134 5016 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.833729 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.834733 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:28.835448 4649 raft_consensus.cc:2393] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 2: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.838586 4527 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 2.
I20260808 07:48:28.840281 4337 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.841277 5016 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:48:28.842082 5016 raft_consensus.cc:697] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Becoming Leader. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:28.844449 5014 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:28.844014 5016 consensus_queue.cc:237] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.844970 5014 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.847148 4996 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:28.848260 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.847965 4996 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.849411 5014 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.850654 4404 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 4.
I20260808 07:48:28.852700 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.853094 4595 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d93ea6f0ee44f84be4e477cdd9e80f7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:28.853305 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.853688 4529 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 4.
I20260808 07:48:28.854652 4996 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.855312 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:28.855541 4337 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters:
I20260808 07:48:28.856559 5014 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 07:48:28.858109 4649 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 4.
I20260808 07:48:28.857939 4528 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da534ee7656240ba82544d75f334f1c5 in term 2.
I20260808 07:48:28.858762 5014 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:28.859584 5014 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 4 FOLLOWER]: Advancing to term 5
I20260808 07:48:28.860227 4337 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, da534ee7656240ba82544d75f334f1c5; no voters: 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.860647 5016 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 07:48:28.861204 5016 raft_consensus.cc:493] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:28.861722 4996 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:48:28.861727 5016 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260808 07:48:28.863911 4996 raft_consensus.cc:697] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Becoming Leader. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:28.865674 4996 consensus_queue.cc:237] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.867292 3970 catalog_manager.cc:5697] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 reported cstate change: term changed from 1 to 2, leader changed from 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66) to da534ee7656240ba82544d75f334f1c5 (127.1.155.65). New cstate: current_term: 2 leader_uuid: "da534ee7656240ba82544d75f334f1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:28.873653 5001 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:28.874295 5001 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.876446 5014 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.878715 5001 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.879598 5014 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 5 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.881239 4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.881542 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.882401 4527 raft_consensus.cc:3060] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 4 FOLLOWER]: Advancing to term 5
I20260808 07:48:28.882668 5016 raft_consensus.cc:515] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.884081 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.885511 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.886438 4528 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 2.
I20260808 07:48:28.887109 5016 leader_election.cc:290] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315)
I20260808 07:48:28.888249 4591 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.888902 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7"
I20260808 07:48:28.900890 4527 raft_consensus.cc:2468] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 5.
I20260808 07:48:28.903798 4649 raft_consensus.cc:2393] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 5: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.904255 5014 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 07:48:28.892022 4403 raft_consensus.cc:2393] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in current term 5: Already voted for candidate da534ee7656240ba82544d75f334f1c5 in this term.
I20260808 07:48:28.905887 4591 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters:
I20260808 07:48:28.893347 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e086226ad6974dbf974c0bb4418b9f00" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.904831 5014 raft_consensus.cc:493] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:28.907622 4528 raft_consensus.cc:2393] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da534ee7656240ba82544d75f334f1c5 in current term 5: Already voted for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in this term.
I20260808 07:48:28.908143 5001 raft_consensus.cc:2804] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260808 07:48:28.907434 5014 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:28.908738 5001 raft_consensus.cc:697] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 LEADER]: Becoming Leader. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Running, Role: LEADER
I20260808 07:48:28.912734 4337 leader_election.cc:304] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:28.914552 5020 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:28.914413 5001 consensus_queue.cc:237] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.915318 5020 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.917534 5016 raft_consensus.cc:2749] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260808 07:48:28.920917 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5" is_pre_election: true
I20260808 07:48:28.921212 5014 raft_consensus.cc:515] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.924976 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:28.925343 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.925789 4528 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 2.
I20260808 07:48:28.927340 4591 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:28.929973 5020 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:28.930727 5020 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 07:48:28.931206 5020 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:28.931722 5020 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:28.942728 5014 leader_election.cc:290] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 election: Requested vote from peers da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:28.941251 3968 catalog_manager.cc:5697] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 reported cstate change: term changed from 3 to 5, leader changed from da534ee7656240ba82544d75f334f1c5 (127.1.155.65) to 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67). New cstate: current_term: 5 leader_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260808 07:48:28.945926 4528 raft_consensus.cc:1275] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Refusing update from remote peer da534ee7656240ba82544d75f334f1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 07:48:28.948920 4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0e77d8fd4340beb9f9cee089cbc9d1" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.950256 5016 consensus_queue.cc:1048] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:28.954043 4528 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:28.967720 4649 raft_consensus.cc:1240] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 2. Current term is 3. Ops: []
I20260808 07:48:28.969862 5016 consensus_queue.cc:1059] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:28.967677 5020 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:28.971832 5016 raft_consensus.cc:3055] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 07:48:28.972978 5016 raft_consensus.cc:740] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:28.975274 5020 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 election: Requested vote from peers 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763), da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009)
I20260808 07:48:28.974558 5016 consensus_queue.cc:260] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:28.976730 5016 raft_consensus.cc:3060] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:28.977103 4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7"
I20260808 07:48:28.977309 4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da534ee7656240ba82544d75f334f1c5"
I20260808 07:48:28.978010 4529 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:28.990516 4528 raft_consensus.cc:2468] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 3.
I20260808 07:48:28.991758 4527 raft_consensus.cc:1240] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260808 07:48:28.992214 4649 raft_consensus.cc:1240] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 2. Current term is 3. Ops: []
I20260808 07:48:28.994262 5016 consensus_queue.cc:1059] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:28.995126 5016 raft_consensus.cc:3055] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 07:48:28.995734 5016 raft_consensus.cc:740] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da534ee7656240ba82544d75f334f1c5, State: Running, Role: LEADER
I20260808 07:48:28.997469 5016 consensus_queue.cc:260] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:29.001674 5016 raft_consensus.cc:3060] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:48:29.006284 4403 raft_consensus.cc:1275] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260808 07:48:29.007217 4591 leader_election.cc:304] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:29.008599 5020 consensus_queue.cc:1048] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260808 07:48:29.011204 5027 raft_consensus.cc:2804] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:48:29.012019 5027 raft_consensus.cc:697] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 LEADER]: Becoming Leader. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Running, Role: LEADER
I20260808 07:48:29.010346 4529 raft_consensus.cc:2468] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d93ea6f0ee44f84be4e477cdd9e80f7 in term 3.
I20260808 07:48:29.018692 4526 raft_consensus.cc:1240] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Rejecting Update request from peer da534ee7656240ba82544d75f334f1c5 for earlier term 2. Current term is 3. Ops: []
I20260808 07:48:29.020143 4591 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7; no voters: da534ee7656240ba82544d75f334f1c5
I20260808 07:48:29.021679 5020 raft_consensus.cc:2804] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:48:29.022202 5020 raft_consensus.cc:697] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 LEADER]: Becoming Leader. State: Replica: 5d93ea6f0ee44f84be4e477cdd9e80f7, State: Running, Role: LEADER
I20260808 07:48:29.023326 5020 consensus_queue.cc:237] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:29.013509 5027 consensus_queue.cc:237] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } }
I20260808 07:48:29.044823 4529 raft_consensus.cc:1275] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 5 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260808 07:48:29.051923 5014 consensus_queue.cc:1048] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260808 07:48:29.089053 3970 catalog_manager.cc:5697] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 reported cstate change: term changed from 2 to 3, leader changed from da534ee7656240ba82544d75f334f1c5 (127.1.155.65) to 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67). New cstate: current_term: 3 leader_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260808 07:48:29.090987 3970 catalog_manager.cc:5697] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 reported cstate change: term changed from 1 to 3, leader changed from 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66) to 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67). New cstate: current_term: 3 leader_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:29.130849 4405 raft_consensus.cc:1275] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260808 07:48:29.131361 4405 pending_rounds.cc:85] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Aborting all ops after (but not including) 2
I20260808 07:48:29.131685 4405 pending_rounds.cc:107] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260808 07:48:29.132130 4405 raft_consensus.cc:2889] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260808 07:48:29.148090 4526 raft_consensus.cc:1275] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:48:29.150058 5020 consensus_queue.cc:1048] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:29.155571 5001 consensus_queue.cc:1048] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:29.160264 4526 raft_consensus.cc:1275] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 07:48:29.165441 5027 consensus_queue.cc:1048] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:29.126963 4403 raft_consensus.cc:1275] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Refusing update from remote peer 5d93ea6f0ee44f84be4e477cdd9e80f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260808 07:48:29.183329 4403 pending_rounds.cc:85] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Aborting all ops after (but not including) 2
I20260808 07:48:29.183986 4403 pending_rounds.cc:107] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260808 07:48:29.184621 4403 raft_consensus.cc:2889] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260808 07:48:29.187968 5016 raft_consensus.cc:493] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:29.188824 5016 raft_consensus.cc:515] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 42315 } } peers { permanent_uuid: "16ba713c60a44ec9a988b586f3d877c7" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 38763 } } peers { permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 } }
I20260808 07:48:29.190155 5027 consensus_queue.cc:1048] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da534ee7656240ba82544d75f334f1c5" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260808 07:48:29.197067 4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d93ea6f0ee44f84be4e477cdd9e80f7" is_pre_election: true
I20260808 07:48:29.216946 4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9c1c3d182346a3a3069a73eb4a940a" candidate_uuid: "da534ee7656240ba82544d75f334f1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "16ba713c60a44ec9a988b586f3d877c7" is_pre_election: true
I20260808 07:48:29.202340 5016 leader_election.cc:290] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d93ea6f0ee44f84be4e477cdd9e80f7 (127.1.155.67:42315), 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763)
I20260808 07:48:29.251878 4337 leader_election.cc:304] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da534ee7656240ba82544d75f334f1c5; no voters: 16ba713c60a44ec9a988b586f3d877c7, 5d93ea6f0ee44f84be4e477cdd9e80f7
I20260808 07:48:29.256206 5016 raft_consensus.cc:2749] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260808 07:48:29.373224 4561 debug-util.cc:398] Leaking SignalData structure 0x7b080015cfc0 after lost signal to thread 1648
W20260808 07:48:29.374804 4561 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5d80 after lost signal to thread 4028
W20260808 07:48:29.376015 4561 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6440 after lost signal to thread 4139
W20260808 07:48:29.377157 4561 debug-util.cc:398] Leaking SignalData structure 0x7b080022e920 after lost signal to thread 4248
W20260808 07:48:29.378705 4561 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1a20 after lost signal to thread 4447
W20260808 07:48:29.379899 4561 debug-util.cc:398] Leaking SignalData structure 0x7b0800032640 after lost signal to thread 4566
W20260808 07:48:29.381096 4561 debug-util.cc:398] Leaking SignalData structure 0x7b0800172de0 after lost signal to thread 4691
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:784: Failure
Expected equality of these values:
live_row_count
Which is: 67
table_info->GetMetrics()->live_row_count->value()
Which is: 0
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:768: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:786: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 784, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:823: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260808 07:48:43.251226 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
W20260808 07:48:43.280314 4595 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260808 07:48:43.286520 4595 consensus_peers.cc:597] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Couldn't send request to peer da534ee7656240ba82544d75f334f1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.297048 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:43.297762 1645 tablet_replica.cc:333] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5: stopping tablet replica
I20260808 07:48:43.298345 1645 raft_consensus.cc:2243] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.299049 1645 raft_consensus.cc:2272] T af0e77d8fd4340beb9f9cee089cbc9d1 P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.301469 1645 tablet_replica.cc:333] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5: stopping tablet replica
I20260808 07:48:43.301944 1645 raft_consensus.cc:2243] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.302389 1645 raft_consensus.cc:2272] T e086226ad6974dbf974c0bb4418b9f00 P da534ee7656240ba82544d75f334f1c5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.304641 1645 tablet_replica.cc:333] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5: stopping tablet replica
I20260808 07:48:43.305081 1645 raft_consensus.cc:2243] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.305605 1645 raft_consensus.cc:2272] T 0c9c1c3d182346a3a3069a73eb4a940a P da534ee7656240ba82544d75f334f1c5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260808 07:48:43.330891 4595 consensus_peers.cc:597] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Couldn't send request to peer da534ee7656240ba82544d75f334f1c5. Status: Network error: Client connection negotiation failed: client connection to 127.1.155.65:38009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.332722 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
W20260808 07:48:43.347834 4595 consensus_peers.cc:597] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer da534ee7656240ba82544d75f334f1c5 (127.1.155.65:38009): Couldn't send request to peer da534ee7656240ba82544d75f334f1c5. Status: Network error: Client connection negotiation failed: client connection to 127.1.155.65:38009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.349529 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
W20260808 07:48:43.365907 4591 consensus_peers.cc:597] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763): Couldn't send request to peer 16ba713c60a44ec9a988b586f3d877c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.388609 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:43.389304 1645 tablet_replica.cc:333] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7: stopping tablet replica
I20260808 07:48:43.389930 1645 raft_consensus.cc:2243] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.390452 1645 raft_consensus.cc:2272] T af0e77d8fd4340beb9f9cee089cbc9d1 P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.392968 1645 tablet_replica.cc:333] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7: stopping tablet replica
I20260808 07:48:43.393548 1645 raft_consensus.cc:2243] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.394156 1645 raft_consensus.cc:2272] T e086226ad6974dbf974c0bb4418b9f00 P 16ba713c60a44ec9a988b586f3d877c7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260808 07:48:43.395504 4591 consensus_peers.cc:597] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763): Couldn't send request to peer 16ba713c60a44ec9a988b586f3d877c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.396896 1645 tablet_replica.cc:333] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7: stopping tablet replica
I20260808 07:48:43.397430 1645 raft_consensus.cc:2243] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.397868 1645 raft_consensus.cc:2272] T 0c9c1c3d182346a3a3069a73eb4a940a P 16ba713c60a44ec9a988b586f3d877c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260808 07:48:43.417703 4591 consensus_peers.cc:597] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 -> Peer 16ba713c60a44ec9a988b586f3d877c7 (127.1.155.66:38763): Couldn't send request to peer 16ba713c60a44ec9a988b586f3d877c7. Status: Network error: Client connection negotiation failed: client connection to 127.1.155.66:38763: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:43.458720 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:43.473349 1645 tablet_server.cc:179] TabletServer@127.1.155.67:0 shutting down...
I20260808 07:48:43.521739 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:43.522538 1645 tablet_replica.cc:333] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7: stopping tablet replica
I20260808 07:48:43.523320 1645 raft_consensus.cc:2243] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 LEADER]: Raft consensus shutting down.
I20260808 07:48:43.524292 1645 raft_consensus.cc:2272] T 0c9c1c3d182346a3a3069a73eb4a940a P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.526628 1645 tablet_replica.cc:333] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7: stopping tablet replica
I20260808 07:48:43.527102 1645 raft_consensus.cc:2243] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 LEADER]: Raft consensus shutting down.
I20260808 07:48:43.527900 1645 raft_consensus.cc:2272] T af0e77d8fd4340beb9f9cee089cbc9d1 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.529937 1645 tablet_replica.cc:333] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7: stopping tablet replica
I20260808 07:48:43.530401 1645 raft_consensus.cc:2243] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 LEADER]: Raft consensus shutting down.
I20260808 07:48:43.531119 1645 raft_consensus.cc:2272] T e086226ad6974dbf974c0bb4418b9f00 P 5d93ea6f0ee44f84be4e477cdd9e80f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.575268 1645 tablet_server.cc:196] TabletServer@127.1.155.67:0 shutdown complete.
I20260808 07:48:43.590983 1645 master.cc:562] Master@127.1.155.126:35639 shutting down...
I20260808 07:48:43.619338 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 LEADER]: Raft consensus shutting down.
I20260808 07:48:43.620430 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.620819 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P c2708100e6a4418886fd1ebea2971042: stopping tablet replica
I20260808 07:48:43.646867 1645 master.cc:584] Master@127.1.155.126:35639 shutdown complete.
I20260808 07:48:43.666612 1645 master.cc:562] Master@127.1.155.125:42215 shutting down...
I20260808 07:48:43.690874 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.691509 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.691862 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0192cfedca3a451da732c9648d519cc9: stopping tablet replica
I20260808 07:48:43.771800 5080 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2708100e6a4418886fd1ebea2971042)
I20260808 07:48:43.772511 5080 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2708100e6a4418886fd1ebea2971042" member_type: VOTER last_known_addr { host: "127.1.155.126" port: 35639 } } peers { permanent_uuid: "0192cfedca3a451da732c9648d519cc9" member_type: VOTER last_known_addr { host: "127.1.155.125" port: 42215 } } peers { permanent_uuid: "c8c3870a6c8b4f2cabb86bdd081560ab" member_type: VOTER last_known_addr { host: "127.1.155.124" port: 35685 } }
I20260808 07:48:43.775451 5080 leader_election.cc:290] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639), 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215)
W20260808 07:48:43.780838 4163 leader_election.cc:336] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c2708100e6a4418886fd1ebea2971042 (127.1.155.126:35639): Network error: Client connection negotiation failed: client connection to 127.1.155.126:35639: connect: Connection refused (error 111)
W20260808 07:48:43.781373 4162 leader_election.cc:336] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0192cfedca3a451da732c9648d519cc9 (127.1.155.125:42215): Network error: Client connection negotiation failed: client connection to 127.1.155.125:42215: connect: Connection refused (error 111)
I20260808 07:48:43.781687 4162 leader_election.cc:304] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c3870a6c8b4f2cabb86bdd081560ab; no voters: 0192cfedca3a451da732c9648d519cc9, c2708100e6a4418886fd1ebea2971042
I20260808 07:48:43.782429 5080 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 07:48:43.788252 1645 master.cc:584] Master@127.1.155.125:42215 shutdown complete.
I20260808 07:48:43.804013 1645 master.cc:562] Master@127.1.155.124:35685 shutting down...
I20260808 07:48:43.828752 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:43.829393 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:43.829703 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8c3870a6c8b4f2cabb86bdd081560ab: stopping tablet replica
I20260808 07:48:43.850449 1645 master.cc:584] Master@127.1.155.124:35685 shutdown complete.
I20260808 07:48:43.875723 1645 test_util.cc:182] -----------------------------------------------
I20260808 07:48:43.875936 1645 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786175273611720-1645-0
[ FAILED ] TsTabletManagerITest.TestTableStats (35225 ms)
[ RUN ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260808 07:48:43.882854 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:42983
I20260808 07:48:43.884214 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:43.889947 5091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:43.890202 5092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:43.892006 5094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:43.892620 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:43.893463 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:43.893659 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:43.893803 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175323893785 us; error 0 us; skew 500 ppm
I20260808 07:48:43.894325 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:43.896715 1645 webserver.cc:533] Webserver started at http://127.1.155.126:42993/ using document root <none> and password file <none>
I20260808 07:48:43.897208 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:43.897394 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:43.897646 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:43.898841 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "6d7cf8db118b4dc28d79a5ea0102b331"
format_stamp: "Formatted at 2026-08-08 07:48:43 on dist-test-slave-pww0"
I20260808 07:48:43.903630 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:43.907056 5108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:43.907878 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:43.908157 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "6d7cf8db118b4dc28d79a5ea0102b331"
format_stamp: "Formatted at 2026-08-08 07:48:43 on dist-test-slave-pww0"
I20260808 07:48:43.908418 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:43.928979 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:43.930253 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:43.970588 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:42983
I20260808 07:48:43.970690 5185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:42983 every 8 connection(s)
I20260808 07:48:43.974836 5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:43.985781 5187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: Bootstrap starting.
I20260808 07:48:43.990887 5187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:43.995728 5187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: No bootstrap required, opened a new log
I20260808 07:48:43.998097 5187 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER }
I20260808 07:48:43.998528 5187 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:43.998775 5187 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7cf8db118b4dc28d79a5ea0102b331, State: Initialized, Role: FOLLOWER
I20260808 07:48:43.999393 5187 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER }
I20260808 07:48:43.999925 5187 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:44.000150 5187 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:44.000402 5187 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:44.005072 5187 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER }
I20260808 07:48:44.005617 5187 leader_election.cc:304] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d7cf8db118b4dc28d79a5ea0102b331; no voters:
I20260808 07:48:44.006827 5187 leader_election.cc:290] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:44.007193 5190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:44.008652 5190 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 1 LEADER]: Becoming Leader. State: Replica: 6d7cf8db118b4dc28d79a5ea0102b331, State: Running, Role: LEADER
I20260808 07:48:44.009392 5190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER }
I20260808 07:48:44.009845 5187 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:44.013065 5191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER } }
I20260808 07:48:44.014411 5192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d7cf8db118b4dc28d79a5ea0102b331. Latest consensus state: current_term: 1 leader_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7cf8db118b4dc28d79a5ea0102b331" member_type: VOTER } }
I20260808 07:48:44.015136 5191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:44.015184 5192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:44.018216 5202 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:44.023590 5202 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:44.026917 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:44.032636 5202 catalog_manager.cc:1383] Generated new cluster ID: b8ea0130e97e46d58ecde0ced864acd9
I20260808 07:48:44.032936 5202 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:44.050168 5202 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:44.051431 5202 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:44.065790 5202 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: Generated new TSK 0
I20260808 07:48:44.066406 5202 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:44.094162 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:44.100684 5221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:44.101502 5222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:44.102869 5225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:44.103451 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:44.104522 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:44.104712 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:44.104835 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175324104823 us; error 0 us; skew 500 ppm
I20260808 07:48:44.105280 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:44.107596 1645 webserver.cc:533] Webserver started at http://127.1.155.65:40707/ using document root <none> and password file <none>
I20260808 07:48:44.108057 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:44.108211 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:44.108419 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:44.109591 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "30d5e165d2c345d9b98a5c9732677f7f"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.114360 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:44.117877 5230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.118721 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:48:44.119024 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "30d5e165d2c345d9b98a5c9732677f7f"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.119313 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:44.158017 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:44.159793 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:44.161484 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:44.164326 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:44.164541 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.164808 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:44.164969 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.209650 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:36959
I20260808 07:48:44.209893 5330 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:36959 every 8 connection(s)
I20260808 07:48:44.216351 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:44.225960 5339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:44.227085 5338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:44.230193 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:44.231246 5342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:44.231868 5333 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42983
I20260808 07:48:44.232252 5333 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:44.232345 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:44.232647 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:44.232834 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175324232816 us; error 0 us; skew 500 ppm
I20260808 07:48:44.233217 5333 heartbeater.cc:507] Master 127.1.155.126:42983 requested a full tablet report, sending...
I20260808 07:48:44.233446 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:44.235677 5133 ts_manager.cc:194] Registered new tserver with Master: 30d5e165d2c345d9b98a5c9732677f7f (127.1.155.65:36959)
I20260808 07:48:44.236791 1645 webserver.cc:533] Webserver started at http://127.1.155.66:46665/ using document root <none> and password file <none>
I20260808 07:48:44.237315 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:44.237530 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:44.237838 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:44.237977 5133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54476
I20260808 07:48:44.239514 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "6396fa5e463742d3bd60669d600536f3"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.244535 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 07:48:44.248164 5347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.248932 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:48:44.249221 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "6396fa5e463742d3bd60669d600536f3"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.249526 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:44.260113 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:44.261408 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:44.262939 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:44.265332 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:44.265537 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.265775 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:44.265925 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.310004 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:41937
I20260808 07:48:44.310113 5448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:41937 every 8 connection(s)
I20260808 07:48:44.315109 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:44.323164 5452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:44.323669 5453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:44.326521 5449 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42983
I20260808 07:48:44.326786 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:44.327013 5449 heartbeater.cc:461] Registering TS with master...
W20260808 07:48:44.327101 5455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:44.328261 5449 heartbeater.cc:507] Master 127.1.155.126:42983 requested a full tablet report, sending...
I20260808 07:48:44.328410 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:44.328717 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:44.328922 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175324328902 us; error 0 us; skew 500 ppm
I20260808 07:48:44.329589 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:44.330793 5133 ts_manager.cc:194] Registered new tserver with Master: 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937)
I20260808 07:48:44.332527 1645 webserver.cc:533] Webserver started at http://127.1.155.67:34949/ using document root <none> and password file <none>
I20260808 07:48:44.332569 5133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54492
I20260808 07:48:44.333173 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:44.333392 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:44.333734 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:44.335534 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root/instance:
uuid: "b77b3d72657147deb85ee21c3ba6dccc"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.340752 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 07:48:44.344657 5463 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.345548 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 07:48:44.345875 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root
uuid: "b77b3d72657147deb85ee21c3ba6dccc"
format_stamp: "Formatted at 2026-08-08 07:48:44 on dist-test-slave-pww0"
I20260808 07:48:44.346136 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:44.368532 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:44.369848 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:44.371411 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:44.373799 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:44.373988 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.374226 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:44.374367 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:44.416090 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.67:34253
I20260808 07:48:44.416179 5555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.67:34253 every 8 connection(s)
I20260808 07:48:44.430195 5559 heartbeater.cc:344] Connected to a master server at 127.1.155.126:42983
I20260808 07:48:44.430647 5559 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:44.431416 5559 heartbeater.cc:507] Master 127.1.155.126:42983 requested a full tablet report, sending...
I20260808 07:48:44.433447 5133 ts_manager.cc:194] Registered new tserver with Master: b77b3d72657147deb85ee21c3ba6dccc (127.1.155.67:34253)
I20260808 07:48:44.433705 1645 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014510689s
I20260808 07:48:44.434847 5133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54506
I20260808 07:48:44.469926 5133 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260808 07:48:44.471875 5133 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:48:44.517781 5387 tablet_service.cc:1511] Processing CreateTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 (DEFAULT_TABLE table=test-table [id=b7869e206922443e80b9c1e66a6b25e9]), partition=
I20260808 07:48:44.519158 5387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e724cb58d1c4836bfef83e6a43a3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:44.520362 5272 tablet_service.cc:1511] Processing CreateTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 (DEFAULT_TABLE table=test-table [id=b7869e206922443e80b9c1e66a6b25e9]), partition=
I20260808 07:48:44.521020 5505 tablet_service.cc:1511] Processing CreateTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 (DEFAULT_TABLE table=test-table [id=b7869e206922443e80b9c1e66a6b25e9]), partition=
I20260808 07:48:44.521481 5272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e724cb58d1c4836bfef83e6a43a3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:44.522228 5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e724cb58d1c4836bfef83e6a43a3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:44.535609 5582 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Bootstrap starting.
I20260808 07:48:44.538281 5583 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Bootstrap starting.
I20260808 07:48:44.542604 5584 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Bootstrap starting.
I20260808 07:48:44.543840 5582 tablet_bootstrap.cc:654] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:44.546144 5583 tablet_bootstrap.cc:654] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:44.548925 5582 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: No bootstrap required, opened a new log
I20260808 07:48:44.549496 5582 ts_tablet_manager.cc:1403] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.006s
I20260808 07:48:44.551383 5584 tablet_bootstrap.cc:654] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:44.552385 5582 raft_consensus.cc:359] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.553169 5582 raft_consensus.cc:385] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:44.553444 5582 raft_consensus.cc:740] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d5e165d2c345d9b98a5c9732677f7f, State: Initialized, Role: FOLLOWER
I20260808 07:48:44.554162 5582 consensus_queue.cc:260] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.557206 5582 ts_tablet_manager.cc:1434] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
W20260808 07:48:44.557454 5582 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 07:48:44.557796 5584 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: No bootstrap required, opened a new log
I20260808 07:48:44.558305 5333 heartbeater.cc:499] Master 127.1.155.126:42983 was elected leader, sending a full tablet report...
I20260808 07:48:44.558436 5584 ts_tablet_manager.cc:1403] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260808 07:48:44.561417 5584 raft_consensus.cc:359] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.561993 5584 raft_consensus.cc:385] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:44.562196 5584 raft_consensus.cc:740] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b3d72657147deb85ee21c3ba6dccc, State: Initialized, Role: FOLLOWER
I20260808 07:48:44.562739 5584 consensus_queue.cc:260] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.557821 5583 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: No bootstrap required, opened a new log
I20260808 07:48:44.564260 5583 ts_tablet_manager.cc:1403] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.010s
I20260808 07:48:44.565079 5559 heartbeater.cc:499] Master 127.1.155.126:42983 was elected leader, sending a full tablet report...
I20260808 07:48:44.566998 5583 raft_consensus.cc:359] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.567580 5583 raft_consensus.cc:385] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:44.567817 5583 raft_consensus.cc:740] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6396fa5e463742d3bd60669d600536f3, State: Initialized, Role: FOLLOWER
I20260808 07:48:44.568365 5583 consensus_queue.cc:260] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.570631 5584 ts_tablet_manager.cc:1434] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
W20260808 07:48:44.570925 5584 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 07:48:44.570569 5449 heartbeater.cc:499] Master 127.1.155.126:42983 was elected leader, sending a full tablet report...
I20260808 07:48:44.572471 5583 ts_tablet_manager.cc:1434] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Time spent starting tablet: real 0.008s user 0.000s sys 0.005s
W20260808 07:48:44.572710 5583 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 07:48:44.610666 5591 raft_consensus.cc:493] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:44.611223 5591 raft_consensus.cc:515] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.613621 5591 leader_election.cc:290] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937), b77b3d72657147deb85ee21c3ba6dccc (127.1.155.67:34253)
I20260808 07:48:44.623554 5402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e724cb58d1c4836bfef83e6a43a3491" candidate_uuid: "30d5e165d2c345d9b98a5c9732677f7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6396fa5e463742d3bd60669d600536f3" is_pre_election: true
I20260808 07:48:44.624450 5402 raft_consensus.cc:2468] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d5e165d2c345d9b98a5c9732677f7f in term 0.
I20260808 07:48:44.625031 5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e724cb58d1c4836bfef83e6a43a3491" candidate_uuid: "30d5e165d2c345d9b98a5c9732677f7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b3d72657147deb85ee21c3ba6dccc" is_pre_election: true
I20260808 07:48:44.625711 5520 raft_consensus.cc:2468] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d5e165d2c345d9b98a5c9732677f7f in term 0.
I20260808 07:48:44.627336 5237 leader_election.cc:304] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d5e165d2c345d9b98a5c9732677f7f, b77b3d72657147deb85ee21c3ba6dccc; no voters:
I20260808 07:48:44.628250 5591 raft_consensus.cc:2804] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:44.628623 5591 raft_consensus.cc:493] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:44.628939 5591 raft_consensus.cc:3060] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:44.634465 5591 raft_consensus.cc:515] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.636109 5591 leader_election.cc:290] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [CANDIDATE]: Term 1 election: Requested vote from peers 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937), b77b3d72657147deb85ee21c3ba6dccc (127.1.155.67:34253)
I20260808 07:48:44.637030 5402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e724cb58d1c4836bfef83e6a43a3491" candidate_uuid: "30d5e165d2c345d9b98a5c9732677f7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6396fa5e463742d3bd60669d600536f3"
I20260808 07:48:44.637296 5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e724cb58d1c4836bfef83e6a43a3491" candidate_uuid: "30d5e165d2c345d9b98a5c9732677f7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b3d72657147deb85ee21c3ba6dccc"
I20260808 07:48:44.637701 5402 raft_consensus.cc:3060] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:44.637840 5520 raft_consensus.cc:3060] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:44.645185 5520 raft_consensus.cc:2468] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d5e165d2c345d9b98a5c9732677f7f in term 1.
I20260808 07:48:44.645190 5402 raft_consensus.cc:2468] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d5e165d2c345d9b98a5c9732677f7f in term 1.
I20260808 07:48:44.646765 5232 leader_election.cc:304] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d5e165d2c345d9b98a5c9732677f7f, 6396fa5e463742d3bd60669d600536f3; no voters:
I20260808 07:48:44.647603 5591 raft_consensus.cc:2804] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:44.648787 5591 raft_consensus.cc:697] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 LEADER]: Becoming Leader. State: Replica: 30d5e165d2c345d9b98a5c9732677f7f, State: Running, Role: LEADER
I20260808 07:48:44.649613 5591 consensus_queue.cc:237] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.658717 5132 catalog_manager.cc:5697] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d5e165d2c345d9b98a5c9732677f7f (127.1.155.65). New cstate: current_term: 1 leader_uuid: "30d5e165d2c345d9b98a5c9732677f7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } health_report { overall_health: UNKNOWN } } }
W20260808 07:48:44.670017 5560 tablet.cc:2406] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:48:44.711580 5387 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:36254
I20260808 07:48:44.713923 5602 tablet_replica.cc:333] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: stopping tablet replica
I20260808 07:48:44.714751 5602 raft_consensus.cc:2243] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:44.715307 5602 raft_consensus.cc:2272] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:44.718355 5602 ts_tablet_manager.cc:1916] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260808 07:48:44.731396 5602 ts_tablet_manager.cc:1929] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260808 07:48:44.731848 5602 log.cc:1199] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root/wals/4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.736593 5603 ts_tablet_manager.cc:933] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Initiating tablet copy from peer 30d5e165d2c345d9b98a5c9732677f7f (127.1.155.65:36959)
I20260808 07:48:44.738838 5603 tablet_copy_client.cc:323] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet copy: Beginning tablet copy session from remote peer at address 127.1.155.65:36959
I20260808 07:48:44.748054 5309 tablet_copy_service.cc:140] P 30d5e165d2c345d9b98a5c9732677f7f: Received BeginTabletCopySession request for tablet 4e724cb58d1c4836bfef83e6a43a3491 from peer 6396fa5e463742d3bd60669d600536f3 ({username='slave'} at 127.0.0.1:43174)
I20260808 07:48:44.748557 5309 tablet_copy_service.cc:161] P 30d5e165d2c345d9b98a5c9732677f7f: Beginning new tablet copy session on tablet 4e724cb58d1c4836bfef83e6a43a3491 from peer 6396fa5e463742d3bd60669d600536f3 at {username='slave'} at 127.0.0.1:43174: session id = 6396fa5e463742d3bd60669d600536f3-4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.754688 5309 tablet_copy_source_session.cc:215] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:48:44.757719 5603 ts_tablet_manager.cc:1916] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260808 07:48:44.768362 5603 ts_tablet_manager.cc:1929] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260808 07:48:44.769019 5603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e724cb58d1c4836bfef83e6a43a3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:44.774438 5603 tablet_copy_client.cc:806] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet copy: Starting download of 0 data blocks...
I20260808 07:48:44.775033 5603 tablet_copy_client.cc:670] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet copy: Starting download of 1 WAL segments...
I20260808 07:48:44.777546 5132 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54518:
table { table_id: "b7869e206922443e80b9c1e66a6b25e9" table_name: "test-table" }
I20260808 07:48:44.778142 5132 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54518:
table { table_id: "b7869e206922443e80b9c1e66a6b25e9" table_name: "test-table" }
I20260808 07:48:44.779635 5603 tablet_copy_client.cc:538] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:48:44.787909 5603 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Bootstrap starting.
I20260808 07:48:44.789379 5132 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: Sending DeleteTablet for 3 replicas of tablet 4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.791664 5387 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:48:44 UTC) from {username='slave'} at 127.0.0.1:36244
I20260808 07:48:44.792155 5272 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:48:44 UTC) from {username='slave'} at 127.0.0.1:43160
I20260808 07:48:44.792629 5505 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:48:44 UTC) from {username='slave'} at 127.0.0.1:51550
W20260808 07:48:44.794245 5109 catalog_manager.cc:5008] TS 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937): delete failed for tablet 4e724cb58d1c4836bfef83e6a43a3491 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e724cb58d1c4836bfef83e6a43a3491 already in progress: copying tablet
I20260808 07:48:44.796463 5606 tablet_replica.cc:333] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: stopping tablet replica
I20260808 07:48:44.797499 5606 raft_consensus.cc:2243] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:44.798475 5606 raft_consensus.cc:2272] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:44.799077 5605 tablet_replica.cc:333] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: stopping tablet replica
I20260808 07:48:44.800009 5605 raft_consensus.cc:2243] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:44.800870 5605 pending_rounds.cc:70] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Trying to abort 1 pending ops.
I20260808 07:48:44.801100 5606 ts_tablet_manager.cc:1916] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:48:44.801354 5605 pending_rounds.cc:77] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316174129773236224 op_type: NO_OP noop_request { }
I20260808 07:48:44.801985 5605 raft_consensus.cc:2889] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260808 07:48:44.802543 5605 raft_consensus.cc:2272] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:44.805810 5605 ts_tablet_manager.cc:1916] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:48:44.807760 5603 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260808 07:48:44.808876 5603 tablet_bootstrap.cc:492] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Bootstrap complete.
I20260808 07:48:44.809588 5603 ts_tablet_manager.cc:1403] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.000s
I20260808 07:48:44.812882 5603 raft_consensus.cc:359] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.813544 5606 ts_tablet_manager.cc:1929] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 07:48:44.813977 5606 log.cc:1199] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-2-root/wals/4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.813876 5603 raft_consensus.cc:740] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6396fa5e463742d3bd60669d600536f3, State: Initialized, Role: FOLLOWER
I20260808 07:48:44.814922 5606 ts_tablet_manager.cc:1950] T 4e724cb58d1c4836bfef83e6a43a3491 P b77b3d72657147deb85ee21c3ba6dccc: Deleting consensus metadata
I20260808 07:48:44.814986 5603 consensus_queue.cc:260] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6396fa5e463742d3bd60669d600536f3" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 41937 } } peers { permanent_uuid: "30d5e165d2c345d9b98a5c9732677f7f" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36959 } } peers { permanent_uuid: "b77b3d72657147deb85ee21c3ba6dccc" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 34253 } }
I20260808 07:48:44.817576 5603 ts_tablet_manager.cc:1434] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260808 07:48:44.817858 5603 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 07:48:44.818200 5112 catalog_manager.cc:5028] TS b77b3d72657147deb85ee21c3ba6dccc (127.1.155.67:34253): tablet 4e724cb58d1c4836bfef83e6a43a3491 (table test-table [id=b7869e206922443e80b9c1e66a6b25e9]) successfully deleted
I20260808 07:48:44.821331 5605 ts_tablet_manager.cc:1929] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 07:48:44.821695 5605 log.cc:1199] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-0-root/wals/4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.822409 5387 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:48:44 UTC) from {username='slave'} at 127.0.0.1:36244
I20260808 07:48:44.822504 5605 ts_tablet_manager.cc:1950] T 4e724cb58d1c4836bfef83e6a43a3491 P 30d5e165d2c345d9b98a5c9732677f7f: Deleting consensus metadata
W20260808 07:48:44.823913 5109 catalog_manager.cc:5008] TS 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937): delete failed for tablet 4e724cb58d1c4836bfef83e6a43a3491 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e724cb58d1c4836bfef83e6a43a3491 already in progress: copying tablet
I20260808 07:48:44.823998 5112 catalog_manager.cc:5028] TS 30d5e165d2c345d9b98a5c9732677f7f (127.1.155.65:36959): tablet 4e724cb58d1c4836bfef83e6a43a3491 (table test-table [id=b7869e206922443e80b9c1e66a6b25e9]) successfully deleted
I20260808 07:48:44.870251 5309 tablet_copy_service.cc:342] P 30d5e165d2c345d9b98a5c9732677f7f: Request end of tablet copy session 6396fa5e463742d3bd60669d600536f3-4e724cb58d1c4836bfef83e6a43a3491 received from {username='slave'} at 127.0.0.1:43174
I20260808 07:48:44.870692 5309 tablet_copy_service.cc:434] P 30d5e165d2c345d9b98a5c9732677f7f: ending tablet copy session 6396fa5e463742d3bd60669d600536f3-4e724cb58d1c4836bfef83e6a43a3491 on tablet 4e724cb58d1c4836bfef83e6a43a3491 with peer 6396fa5e463742d3bd60669d600536f3
I20260808 07:48:44.874928 5387 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e724cb58d1c4836bfef83e6a43a3491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:48:44 UTC) from {username='slave'} at 127.0.0.1:36244
I20260808 07:48:44.875677 5602 tablet_replica.cc:333] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: stopping tablet replica
I20260808 07:48:44.876261 5602 raft_consensus.cc:2243] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:44.876636 5602 pending_rounds.cc:70] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Trying to abort 1 pending ops.
I20260808 07:48:44.876852 5602 pending_rounds.cc:77] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316174129773236224 op_type: NO_OP noop_request { }
I20260808 07:48:44.877135 5602 raft_consensus.cc:2889] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 07:48:44.877434 5602 raft_consensus.cc:2272] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:44.879668 5602 ts_tablet_manager.cc:1916] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:48:44.890574 5602 ts_tablet_manager.cc:1929] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 07:48:44.890928 5602 log.cc:1199] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786175273611720-1645-0/minicluster-data/ts-1-root/wals/4e724cb58d1c4836bfef83e6a43a3491
I20260808 07:48:44.891590 5602 ts_tablet_manager.cc:1950] T 4e724cb58d1c4836bfef83e6a43a3491 P 6396fa5e463742d3bd60669d600536f3: Deleting consensus metadata
I20260808 07:48:44.893996 5109 catalog_manager.cc:5028] TS 6396fa5e463742d3bd60669d600536f3 (127.1.155.66:41937): tablet 4e724cb58d1c4836bfef83e6a43a3491 (table test-table [id=b7869e206922443e80b9c1e66a6b25e9]) successfully deleted
I20260808 07:48:44.931905 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:44.949663 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:44.968379 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:44.978289 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:44.995571 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:45.013042 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:45.023865 1645 tablet_server.cc:179] TabletServer@127.1.155.67:0 shutting down...
I20260808 07:48:45.043121 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:45.059762 1645 tablet_server.cc:196] TabletServer@127.1.155.67:0 shutdown complete.
I20260808 07:48:45.069160 1645 master.cc:562] Master@127.1.155.126:42983 shutting down...
I20260808 07:48:45.087278 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:45.087893 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:45.088239 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d7cf8db118b4dc28d79a5ea0102b331: stopping tablet replica
I20260808 07:48:45.107293 1645 master.cc:584] Master@127.1.155.126:42983 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1260 ms)
[----------] 4 tests from TsTabletManagerITest (39652 ms total)
[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260808 07:48:45.143424 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:41369
I20260808 07:48:45.144709 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:45.150718 5612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:45.151047 5614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:45.153476 5619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:45.153625 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:45.154743 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:45.154978 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:45.155153 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175325155115 us; error 0 us; skew 500 ppm
I20260808 07:48:45.155798 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:45.158360 1645 webserver.cc:533] Webserver started at http://127.1.155.126:42575/ using document root <none> and password file <none>
I20260808 07:48:45.158885 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:45.159073 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:45.159333 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:45.160620 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "0743d547421647d8b0bb50ecee03158d"
format_stamp: "Formatted at 2026-08-08 07:48:45 on dist-test-slave-pww0"
I20260808 07:48:45.165529 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 07:48:45.169303 5625 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:45.170194 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:48:45.170502 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "0743d547421647d8b0bb50ecee03158d"
format_stamp: "Formatted at 2026-08-08 07:48:45 on dist-test-slave-pww0"
I20260808 07:48:45.170780 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:45.209141 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:45.210397 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:45.250461 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:41369
I20260808 07:48:45.250569 5707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:41369 every 8 connection(s)
I20260808 07:48:45.254737 5709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:45.265419 5709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d: Bootstrap starting.
I20260808 07:48:45.270360 5709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:45.274968 5709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d: No bootstrap required, opened a new log
I20260808 07:48:45.277256 5709 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER }
I20260808 07:48:45.277654 5709 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:45.277928 5709 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0743d547421647d8b0bb50ecee03158d, State: Initialized, Role: FOLLOWER
I20260808 07:48:45.278501 5709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER }
I20260808 07:48:45.278947 5709 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:45.279167 5709 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:45.279428 5709 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:45.284090 5709 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER }
I20260808 07:48:45.284641 5709 leader_election.cc:304] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0743d547421647d8b0bb50ecee03158d; no voters:
I20260808 07:48:45.285849 5709 leader_election.cc:290] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:45.286214 5713 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:45.287552 5713 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 1 LEADER]: Becoming Leader. State: Replica: 0743d547421647d8b0bb50ecee03158d, State: Running, Role: LEADER
I20260808 07:48:45.288273 5713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER }
I20260808 07:48:45.288789 5709 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:45.291712 5714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0743d547421647d8b0bb50ecee03158d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER } }
I20260808 07:48:45.292410 5714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:45.291643 5715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0743d547421647d8b0bb50ecee03158d. Latest consensus state: current_term: 1 leader_uuid: "0743d547421647d8b0bb50ecee03158d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0743d547421647d8b0bb50ecee03158d" member_type: VOTER } }
I20260808 07:48:45.293121 5715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:45.296363 5719 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:45.303869 5719 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:45.306290 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:45.313537 5719 catalog_manager.cc:1383] Generated new cluster ID: d5208c7540394dfdb90846e6ba9efd07
I20260808 07:48:45.313828 5719 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:45.335532 5719 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:45.336822 5719 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:45.355311 5719 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d: Generated new TSK 0
I20260808 07:48:45.356048 5719 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:45.373112 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:45.379415 5737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:45.380379 5738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:45.382742 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:45.382998 5744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:45.383991 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:45.384207 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:45.384332 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175325384320 us; error 0 us; skew 500 ppm
I20260808 07:48:45.384822 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:45.387284 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43093/ using document root <none> and password file <none>
I20260808 07:48:45.387826 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:45.388005 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:45.388232 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:45.389353 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "25cbb23630824dea9cc4b58292a131d2"
format_stamp: "Formatted at 2026-08-08 07:48:45 on dist-test-slave-pww0"
I20260808 07:48:45.394357 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:45.398087 5749 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:45.398922 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:45.399232 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "25cbb23630824dea9cc4b58292a131d2"
format_stamp: "Formatted at 2026-08-08 07:48:45 on dist-test-slave-pww0"
I20260808 07:48:45.399550 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:45.418310 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:45.419566 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:45.425159 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:45.425449 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:45.425756 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:45.425976 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:45.480239 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:36563
I20260808 07:48:45.480356 5874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:36563 every 8 connection(s)
I20260808 07:48:45.485301 5878 heartbeater.cc:344] Connected to a master server at 127.1.155.126:41369
I20260808 07:48:45.485673 5878 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:45.486431 5878 heartbeater.cc:507] Master 127.1.155.126:41369 requested a full tablet report, sending...
I20260808 07:48:45.488669 5653 ts_manager.cc:194] Registered new tserver with Master: 25cbb23630824dea9cc4b58292a131d2 (127.1.155.65:36563)
I20260808 07:48:45.489744 1645 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006147701s
I20260808 07:48:45.490767 5653 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33842
I20260808 07:48:45.523921 5817 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 07:48:45.525540 5817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:45.538668 5891 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Bootstrap starting.
I20260808 07:48:45.544010 5891 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:45.548295 5891 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: No bootstrap required, opened a new log
I20260808 07:48:45.548700 5891 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 07:48:45.550761 5891 raft_consensus.cc:359] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.551163 5891 raft_consensus.cc:385] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:45.551347 5891 raft_consensus.cc:740] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25cbb23630824dea9cc4b58292a131d2, State: Initialized, Role: FOLLOWER
I20260808 07:48:45.551901 5891 consensus_queue.cc:260] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.552328 5891 raft_consensus.cc:399] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:45.552529 5891 raft_consensus.cc:493] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:45.552749 5891 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:45.557530 5891 raft_consensus.cc:515] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.558094 5891 leader_election.cc:304] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25cbb23630824dea9cc4b58292a131d2; no voters:
I20260808 07:48:45.559276 5891 leader_election.cc:290] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:45.559688 5894 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:45.561045 5894 raft_consensus.cc:697] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 LEADER]: Becoming Leader. State: Replica: 25cbb23630824dea9cc4b58292a131d2, State: Running, Role: LEADER
I20260808 07:48:45.561296 5878 heartbeater.cc:499] Master 127.1.155.126:41369 was elected leader, sending a full tablet report...
I20260808 07:48:45.561859 5891 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 07:48:45.561832 5894 consensus_queue.cc:237] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.567368 5896 tablet_replica.cc:442] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25cbb23630824dea9cc4b58292a131d2" committed_config { opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } } }
I20260808 07:48:45.568074 5896 tablet_replica.cc:445] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:45.568673 5898 tablet_replica.cc:442] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: TxnStatusTablet state changed. Reason: New leader 25cbb23630824dea9cc4b58292a131d2. Latest consensus state: current_term: 1 leader_uuid: "25cbb23630824dea9cc4b58292a131d2" committed_config { opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } } }
I20260808 07:48:45.569132 5898 tablet_replica.cc:445] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:45.570179 5901 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
W20260808 07:48:45.570397 5653 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:45.570715 5901 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 07:48:45.574955 5653 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:45.608579 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:45.628794 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:45.629618 1645 tablet_replica.cc:333] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: stopping tablet replica
I20260808 07:48:45.630203 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:45.630724 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:45.653247 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:45.665488 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:45.671734 5907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:45.673475 5910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:45.674988 5912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:45.677438 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:45.678682 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:45.678956 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:45.679162 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175325679143 us; error 0 us; skew 500 ppm
I20260808 07:48:45.679997 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:45.682936 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43093/ using document root <none> and password file <none>
I20260808 07:48:45.683672 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:45.683910 1645 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 07:48:45.689116 1645 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 07:48:45.693082 5923 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:45.694064 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 07:48:45.694450 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "25cbb23630824dea9cc4b58292a131d2"
format_stamp: "Formatted at 2026-08-08 07:48:45 on dist-test-slave-pww0"
I20260808 07:48:45.694844 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:45.730237 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:45.731690 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:45.741101 5937 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260808 07:48:45.748653 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:48:45.749019 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.010s user 0.002s sys 0.000s
I20260808 07:48:45.749364 1645 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260808 07:48:45.756709 5937 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Bootstrap starting.
I20260808 07:48:45.757238 1645 ts_tablet_manager.cc:616] Registered 1 tablets
I20260808 07:48:45.757556 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.008s user 0.008s sys 0.000s
I20260808 07:48:45.794672 5937 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:48:45.795961 5937 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Bootstrap complete.
I20260808 07:48:45.796893 5937 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Time spent bootstrapping tablet: real 0.040s user 0.029s sys 0.008s
I20260808 07:48:45.800462 5937 raft_consensus.cc:359] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.801052 5937 raft_consensus.cc:740] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25cbb23630824dea9cc4b58292a131d2, State: Initialized, Role: FOLLOWER
I20260808 07:48:45.801919 5937 consensus_queue.cc:260] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.802580 5937 raft_consensus.cc:399] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:45.802865 5937 raft_consensus.cc:493] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:45.803197 5937 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:45.810458 5937 raft_consensus.cc:515] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.811199 5937 leader_election.cc:304] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25cbb23630824dea9cc4b58292a131d2; no voters:
I20260808 07:48:45.817135 5937 leader_election.cc:290] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:48:45.817404 5954 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:48:45.819849 5937 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2: Time spent starting tablet: real 0.023s user 0.022s sys 0.000s
I20260808 07:48:45.822146 5954 raft_consensus.cc:697] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 2 LEADER]: Becoming Leader. State: Replica: 25cbb23630824dea9cc4b58292a131d2, State: Running, Role: LEADER
I20260808 07:48:45.823182 5954 consensus_queue.cc:237] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } }
I20260808 07:48:45.826669 5960 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 25cbb23630824dea9cc4b58292a131d2. Latest consensus state: current_term: 2 leader_uuid: "25cbb23630824dea9cc4b58292a131d2" committed_config { opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } } }
I20260808 07:48:45.827382 5960 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:45.829097 5959 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "25cbb23630824dea9cc4b58292a131d2" committed_config { opid_index: -1 peers { permanent_uuid: "25cbb23630824dea9cc4b58292a131d2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 36563 } } }
I20260808 07:48:45.829747 5959 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:45.837805 5967 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:48:45.838433 5967 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260808 07:48:45.890290 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:36563
I20260808 07:48:45.890444 6038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:36563 every 8 connection(s)
I20260808 07:48:45.897754 6039 heartbeater.cc:344] Connected to a master server at 127.1.155.126:41369
I20260808 07:48:45.898226 1645 tablet_server.cc:179] TabletServer@127.1.155.65:36563 shutting down...
I20260808 07:48:45.900162 6039 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:45.901319 6039 heartbeater.cc:507] Master 127.1.155.126:41369 requested a full tablet report, sending...
I20260808 07:48:45.906248 5653 ts_manager.cc:194] Re-registered known tserver with Master: 25cbb23630824dea9cc4b58292a131d2 (127.1.155.65:36563)
W20260808 07:48:45.906778 5653 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:45.908109 5653 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33870
I20260808 07:48:45.911302 6039 heartbeater.cc:499] Master 127.1.155.126:41369 was elected leader, sending a full tablet report...
W20260808 07:48:45.916757 5653 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:45.933458 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:45.934764 1645 tablet_replica.cc:333] stopping tablet replica
I20260808 07:48:45.935443 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 2 LEADER]: Raft consensus shutting down.
I20260808 07:48:45.936079 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 25cbb23630824dea9cc4b58292a131d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:45.958305 1645 tablet_server.cc:196] TabletServer@127.1.155.65:36563 shutdown complete.
I20260808 07:48:45.972918 1645 master.cc:562] Master@127.1.155.126:41369 shutting down...
I20260808 07:48:45.992033 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:45.992594 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:45.992923 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0743d547421647d8b0bb50ecee03158d: stopping tablet replica
I20260808 07:48:46.011929 1645 master.cc:584] Master@127.1.155.126:41369 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (893 ms)
[ RUN ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260808 07:48:46.037451 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:44455
I20260808 07:48:46.038626 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:46.044241 6051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.046972 6052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:46.050254 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:46.050184 6057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:46.051388 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:46.051632 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:46.051792 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175326051774 us; error 0 us; skew 500 ppm
I20260808 07:48:46.052341 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:46.055130 1645 webserver.cc:533] Webserver started at http://127.1.155.126:40203/ using document root <none> and password file <none>
I20260808 07:48:46.055747 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:46.055940 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:46.056200 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:46.057318 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "93388929604c4d318dc3e08c5ea8f374"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.062418 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 07:48:46.066231 6064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.067165 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 07:48:46.067512 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "93388929604c4d318dc3e08c5ea8f374"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.067829 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:46.102569 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:46.103674 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:46.152644 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:44455
I20260808 07:48:46.152777 6145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:44455 every 8 connection(s)
I20260808 07:48:46.156847 6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:46.167495 6147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374: Bootstrap starting.
I20260808 07:48:46.172253 6147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:46.176664 6147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374: No bootstrap required, opened a new log
I20260808 07:48:46.178768 6147 raft_consensus.cc:359] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER }
I20260808 07:48:46.179193 6147 raft_consensus.cc:385] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:46.179418 6147 raft_consensus.cc:740] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93388929604c4d318dc3e08c5ea8f374, State: Initialized, Role: FOLLOWER
I20260808 07:48:46.180039 6147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER }
I20260808 07:48:46.180522 6147 raft_consensus.cc:399] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:46.180756 6147 raft_consensus.cc:493] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:46.181003 6147 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:46.185936 6147 raft_consensus.cc:515] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER }
I20260808 07:48:46.186538 6147 leader_election.cc:304] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93388929604c4d318dc3e08c5ea8f374; no voters:
I20260808 07:48:46.187948 6147 leader_election.cc:290] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:46.188316 6151 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:46.190133 6151 raft_consensus.cc:697] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 1 LEADER]: Becoming Leader. State: Replica: 93388929604c4d318dc3e08c5ea8f374, State: Running, Role: LEADER
I20260808 07:48:46.190905 6151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER }
I20260808 07:48:46.191489 6147 sys_catalog.cc:565] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:46.195813 6152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93388929604c4d318dc3e08c5ea8f374" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER } }
I20260808 07:48:46.195859 6153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93388929604c4d318dc3e08c5ea8f374. Latest consensus state: current_term: 1 leader_uuid: "93388929604c4d318dc3e08c5ea8f374" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93388929604c4d318dc3e08c5ea8f374" member_type: VOTER } }
I20260808 07:48:46.196777 6152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:46.196786 6153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:46.208153 6157 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:46.215521 6157 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:46.218274 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:46.225829 6157 catalog_manager.cc:1383] Generated new cluster ID: b0520119a35446b995edefe03e7baf64
I20260808 07:48:46.226171 6157 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:46.248013 6157 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:46.249393 6157 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:46.263537 6157 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374: Generated new TSK 0
I20260808 07:48:46.264211 6157 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:46.284997 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:46.291628 6181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.293284 6183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.295879 6185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:46.296032 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:46.297057 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:46.297251 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:46.297405 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175326297388 us; error 0 us; skew 500 ppm
I20260808 07:48:46.297923 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:46.300848 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43933/ using document root <none> and password file <none>
I20260808 07:48:46.301357 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:46.301548 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:46.301805 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:46.302906 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.308182 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 07:48:46.311829 6191 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.312721 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 07:48:46.313104 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.313493 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:46.334023 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:46.335556 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:46.344249 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:46.344616 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.344969 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:46.345242 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.420135 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:33791
I20260808 07:48:46.420248 6309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:33791 every 8 connection(s)
I20260808 07:48:46.425282 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 07:48:46.425765 6310 heartbeater.cc:344] Connected to a master server at 127.1.155.126:44455
I20260808 07:48:46.426182 6310 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:46.427085 6310 heartbeater.cc:507] Master 127.1.155.126:44455 requested a full tablet report, sending...
I20260808 07:48:46.429700 6087 ts_manager.cc:194] Registered new tserver with Master: 6c5db6b37e6a4c8d9620829c8fdc71e2 (127.1.155.65:33791)
I20260808 07:48:46.432392 6087 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43706
W20260808 07:48:46.432588 6312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.435273 6314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.438659 6316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:46.439206 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:46.440128 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:46.440335 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:46.440497 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175326440480 us; error 0 us; skew 500 ppm
I20260808 07:48:46.441030 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:46.443637 1645 webserver.cc:533] Webserver started at http://127.1.155.66:35121/ using document root <none> and password file <none>
I20260808 07:48:46.444121 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:46.444296 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:46.444559 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:46.445652 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "1e524f9400e94d9399b057bfb79bbdf9"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.450587 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 07:48:46.454414 6323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.455365 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 07:48:46.455762 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "1e524f9400e94d9399b057bfb79bbdf9"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.456050 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:46.481139 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:46.482298 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:46.487520 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:46.487937 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 07:48:46.488267 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:46.488502 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.553869 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:41053
I20260808 07:48:46.554028 6421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:41053 every 8 connection(s)
I20260808 07:48:46.559240 6422 heartbeater.cc:344] Connected to a master server at 127.1.155.126:44455
I20260808 07:48:46.559659 6422 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:46.560454 6422 heartbeater.cc:507] Master 127.1.155.126:44455 requested a full tablet report, sending...
I20260808 07:48:46.562668 6087 ts_manager.cc:194] Registered new tserver with Master: 1e524f9400e94d9399b057bfb79bbdf9 (127.1.155.66:41053)
I20260808 07:48:46.562776 1645 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.00528923s
I20260808 07:48:46.564635 6087 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43712
I20260808 07:48:46.598707 6253 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 07:48:46.600055 6253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:46.612691 6435 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Bootstrap starting.
I20260808 07:48:46.617538 6435 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:46.621747 6435 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: No bootstrap required, opened a new log
I20260808 07:48:46.622148 6435 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 07:48:46.624317 6435 raft_consensus.cc:359] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.624775 6435 raft_consensus.cc:385] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:46.624996 6435 raft_consensus.cc:740] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5db6b37e6a4c8d9620829c8fdc71e2, State: Initialized, Role: FOLLOWER
I20260808 07:48:46.625550 6435 consensus_queue.cc:260] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.626046 6435 raft_consensus.cc:399] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:46.626283 6435 raft_consensus.cc:493] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:46.626533 6435 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:46.631255 6435 raft_consensus.cc:515] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.631888 6435 leader_election.cc:304] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c5db6b37e6a4c8d9620829c8fdc71e2; no voters:
I20260808 07:48:46.633288 6435 leader_election.cc:290] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:46.633680 6437 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:46.635403 6310 heartbeater.cc:499] Master 127.1.155.126:44455 was elected leader, sending a full tablet report...
I20260808 07:48:46.635978 6435 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260808 07:48:46.636788 6437 raft_consensus.cc:697] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5db6b37e6a4c8d9620829c8fdc71e2, State: Running, Role: LEADER
I20260808 07:48:46.637409 6437 consensus_queue.cc:237] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.641337 6438 tablet_replica.cc:442] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" committed_config { opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } } }
I20260808 07:48:46.641932 6438 tablet_replica.cc:445] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: This TxnStatusTablet replica's current role is: LEADER
W20260808 07:48:46.643913 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:46.647692 6440 tablet_replica.cc:442] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: TxnStatusTablet state changed. Reason: New leader 6c5db6b37e6a4c8d9620829c8fdc71e2. Latest consensus state: current_term: 1 leader_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" committed_config { opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } } }
I20260808 07:48:46.648392 6440 tablet_replica.cc:445] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:46.653934 6444 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:48:46.654372 6444 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 07:48:46.655742 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:46.711702 6450 ts_tablet_manager.cc:933] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Initiating tablet copy from peer 6c5db6b37e6a4c8d9620829c8fdc71e2 (127.1.155.65:33791)
I20260808 07:48:46.713531 6450 tablet_copy_client.cc:323] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: tablet copy: Beginning tablet copy session from remote peer at address 127.1.155.65:33791
I20260808 07:48:46.722812 6287 tablet_copy_service.cc:140] P 6c5db6b37e6a4c8d9620829c8fdc71e2: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer 1e524f9400e94d9399b057bfb79bbdf9 ({username='slave'} at 127.0.0.1:45832)
I20260808 07:48:46.723315 6287 tablet_copy_service.cc:161] P 6c5db6b37e6a4c8d9620829c8fdc71e2: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer 1e524f9400e94d9399b057bfb79bbdf9 at {username='slave'} at 127.0.0.1:45832: session id = 1e524f9400e94d9399b057bfb79bbdf9-11111111111111111111111111111111
I20260808 07:48:46.728406 6287 tablet_copy_source_session.cc:215] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:48:46.731922 6450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:46.750177 6450 tablet_copy_client.cc:806] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: tablet copy: Starting download of 0 data blocks...
I20260808 07:48:46.750945 6450 tablet_copy_client.cc:670] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: tablet copy: Starting download of 1 WAL segments...
I20260808 07:48:46.754774 6450 tablet_copy_client.cc:538] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:48:46.764505 6450 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Bootstrap starting.
I20260808 07:48:46.789522 6450 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:48:46.790556 6450 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Bootstrap complete.
I20260808 07:48:46.791306 6450 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Time spent bootstrapping tablet: real 0.027s user 0.023s sys 0.000s
I20260808 07:48:46.794080 6450 raft_consensus.cc:359] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.794549 6450 raft_consensus.cc:740] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 1e524f9400e94d9399b057bfb79bbdf9, State: Initialized, Role: NON_PARTICIPANT
I20260808 07:48:46.795131 6450 consensus_queue.cc:260] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:46.797982 6453 tablet_replica.cc:442] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } } }
I20260808 07:48:46.798170 6422 heartbeater.cc:499] Master 127.1.155.126:44455 was elected leader, sending a full tablet report...
I20260808 07:48:46.798522 6453 tablet_replica.cc:445] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260808 07:48:46.800549 6450 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
W20260808 07:48:46.801555 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:46.802948 6287 tablet_copy_service.cc:342] P 6c5db6b37e6a4c8d9620829c8fdc71e2: Request end of tablet copy session 1e524f9400e94d9399b057bfb79bbdf9-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:45832
I20260808 07:48:46.803285 6287 tablet_copy_service.cc:434] P 6c5db6b37e6a4c8d9620829c8fdc71e2: ending tablet copy session 1e524f9400e94d9399b057bfb79bbdf9-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer 1e524f9400e94d9399b057bfb79bbdf9
W20260808 07:48:46.807578 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:46.815403 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:46.850857 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:46.852197 1645 tablet_replica.cc:333] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: stopping tablet replica
I20260808 07:48:46.852967 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:46.853567 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:46.869560 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:46.888108 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:46.895964 6454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.896291 6455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:46.903388 6458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:46.903539 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:46.905256 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:46.905565 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:46.905779 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175326905751 us; error 0 us; skew 500 ppm
I20260808 07:48:46.906469 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:46.910542 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43933/ using document root <none> and password file <none>
I20260808 07:48:46.911286 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:46.911563 1645 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 07:48:46.917366 1645 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 07:48:46.921459 6466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:46.922492 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 07:48:46.922899 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2"
format_stamp: "Formatted at 2026-08-08 07:48:46 on dist-test-slave-pww0"
I20260808 07:48:46.923317 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:46.941717 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:46.943269 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:46.959156 6481 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260808 07:48:46.969521 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:48:46.969964 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.001s sys 0.001s
I20260808 07:48:46.970369 1645 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260808 07:48:46.977393 1645 ts_tablet_manager.cc:616] Registered 1 tablets
I20260808 07:48:46.977784 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.007s user 0.007s sys 0.000s
I20260808 07:48:46.977810 6481 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Bootstrap starting.
I20260808 07:48:47.023280 6481 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:48:47.024421 6481 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Bootstrap complete.
I20260808 07:48:47.025182 6481 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Time spent bootstrapping tablet: real 0.048s user 0.030s sys 0.011s
I20260808 07:48:47.028705 6481 raft_consensus.cc:359] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:47.029415 6481 raft_consensus.cc:740] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5db6b37e6a4c8d9620829c8fdc71e2, State: Initialized, Role: FOLLOWER
I20260808 07:48:47.030490 6481 consensus_queue.cc:260] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:47.031411 6481 raft_consensus.cc:399] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:47.031879 6481 raft_consensus.cc:493] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:47.032220 6481 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:48:47.040290 6481 raft_consensus.cc:515] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:47.041147 6481 leader_election.cc:304] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c5db6b37e6a4c8d9620829c8fdc71e2; no voters:
I20260808 07:48:47.060998 6481 leader_election.cc:290] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:48:47.061355 6534 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:48:47.063917 6481 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2: Time spent starting tablet: real 0.038s user 0.023s sys 0.013s
I20260808 07:48:47.069422 6534 raft_consensus.cc:697] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5db6b37e6a4c8d9620829c8fdc71e2, State: Running, Role: LEADER
I20260808 07:48:47.070464 6534 consensus_queue.cc:237] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } }
I20260808 07:48:47.080734 6537 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" committed_config { opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } } }
I20260808 07:48:47.081405 6537 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:47.087893 6540 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 6c5db6b37e6a4c8d9620829c8fdc71e2. Latest consensus state: current_term: 2 leader_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" committed_config { opid_index: -1 peers { permanent_uuid: "6c5db6b37e6a4c8d9620829c8fdc71e2" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33791 } } }
I20260808 07:48:47.088577 6540 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:47.092290 6548 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:48:47.092828 6548 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260808 07:48:47.120500 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:33791
I20260808 07:48:47.120607 6583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:33791 every 8 connection(s)
I20260808 07:48:47.127022 6584 heartbeater.cc:344] Connected to a master server at 127.1.155.126:44455
I20260808 07:48:47.127570 6584 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:47.128590 6584 heartbeater.cc:507] Master 127.1.155.126:44455 requested a full tablet report, sending...
I20260808 07:48:47.132192 6087 ts_manager.cc:194] Re-registered known tserver with Master: 6c5db6b37e6a4c8d9620829c8fdc71e2 (127.1.155.65:33791)
W20260808 07:48:47.132915 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:47.134708 6087 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43738
I20260808 07:48:47.136893 1645 tablet_server.cc:179] TabletServer@127.1.155.65:33791 shutting down...
I20260808 07:48:47.144346 6584 heartbeater.cc:499] Master 127.1.155.126:44455 was elected leader, sending a full tablet report...
W20260808 07:48:47.153066 6087 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:47.174407 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:47.175364 1645 tablet_replica.cc:333] stopping tablet replica
I20260808 07:48:47.176154 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 2 LEADER]: Raft consensus shutting down.
I20260808 07:48:47.176796 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 6c5db6b37e6a4c8d9620829c8fdc71e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:47.192199 1645 tablet_server.cc:196] TabletServer@127.1.155.65:33791 shutdown complete.
I20260808 07:48:47.205169 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:47.223658 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:47.224596 1645 tablet_replica.cc:333] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9: stopping tablet replica
I20260808 07:48:47.225282 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 07:48:47.225775 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 1e524f9400e94d9399b057bfb79bbdf9 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 07:48:47.245723 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:47.259558 1645 master.cc:562] Master@127.1.155.126:44455 shutting down...
I20260808 07:48:47.284736 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:47.285281 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:47.285594 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 93388929604c4d318dc3e08c5ea8f374: stopping tablet replica
I20260808 07:48:47.304869 1645 master.cc:584] Master@127.1.155.126:44455 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1301 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260808 07:48:47.340723 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:38197
I20260808 07:48:47.342237 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:47.348600 6592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:47.351148 6593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:47.352187 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:47.353701 6599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:47.354609 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:47.354815 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:47.354988 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175327354968 us; error 0 us; skew 500 ppm
I20260808 07:48:47.355607 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:47.358283 1645 webserver.cc:533] Webserver started at http://127.1.155.126:38667/ using document root <none> and password file <none>
I20260808 07:48:47.358778 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:47.358973 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:47.359225 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:47.360394 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "45937dcddc314e599bc8e24032df7afc"
format_stamp: "Formatted at 2026-08-08 07:48:47 on dist-test-slave-pww0"
I20260808 07:48:47.365432 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 07:48:47.369300 6607 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:47.370189 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 07:48:47.370502 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "45937dcddc314e599bc8e24032df7afc"
format_stamp: "Formatted at 2026-08-08 07:48:47 on dist-test-slave-pww0"
I20260808 07:48:47.370790 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:47.385027 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:47.386121 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:47.434000 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:38197
I20260808 07:48:47.434177 6692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:38197 every 8 connection(s)
I20260808 07:48:47.438428 6696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:47.449457 6696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc: Bootstrap starting.
I20260808 07:48:47.454128 6696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:47.458420 6696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc: No bootstrap required, opened a new log
I20260808 07:48:47.460582 6696 raft_consensus.cc:359] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER }
I20260808 07:48:47.460968 6696 raft_consensus.cc:385] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:47.461195 6696 raft_consensus.cc:740] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45937dcddc314e599bc8e24032df7afc, State: Initialized, Role: FOLLOWER
I20260808 07:48:47.461755 6696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER }
I20260808 07:48:47.462208 6696 raft_consensus.cc:399] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:47.462419 6696 raft_consensus.cc:493] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:47.462778 6696 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:47.467624 6696 raft_consensus.cc:515] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER }
I20260808 07:48:47.468183 6696 leader_election.cc:304] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45937dcddc314e599bc8e24032df7afc; no voters:
I20260808 07:48:47.469470 6696 leader_election.cc:290] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:47.469867 6699 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:47.471496 6699 raft_consensus.cc:697] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 1 LEADER]: Becoming Leader. State: Replica: 45937dcddc314e599bc8e24032df7afc, State: Running, Role: LEADER
I20260808 07:48:47.472307 6699 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER }
I20260808 07:48:47.472648 6696 sys_catalog.cc:565] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:47.475378 6700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45937dcddc314e599bc8e24032df7afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER } }
I20260808 07:48:47.475950 6700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:47.486021 6702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45937dcddc314e599bc8e24032df7afc. Latest consensus state: current_term: 1 leader_uuid: "45937dcddc314e599bc8e24032df7afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45937dcddc314e599bc8e24032df7afc" member_type: VOTER } }
I20260808 07:48:47.486687 6702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:47.487602 6708 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:47.494930 6708 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:47.496081 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:47.505771 6708 catalog_manager.cc:1383] Generated new cluster ID: ac120d55670847df9df08e0c951a0f3d
I20260808 07:48:47.506111 6708 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:47.529851 6708 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:47.531176 6708 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:47.547600 6708 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc: Generated new TSK 0
I20260808 07:48:47.548223 6708 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:47.562707 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:47.569373 6738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:47.571440 6739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:47.572722 6741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:47.573943 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:47.575064 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:47.575336 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:47.575558 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175327575539 us; error 0 us; skew 500 ppm
I20260808 07:48:47.576303 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:47.579144 1645 webserver.cc:533] Webserver started at http://127.1.155.65:43997/ using document root <none> and password file <none>
I20260808 07:48:47.579795 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:47.580022 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:47.580338 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:47.581848 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "11d5a578b72d4730ae93cb9d6a9237c3"
format_stamp: "Formatted at 2026-08-08 07:48:47 on dist-test-slave-pww0"
I20260808 07:48:47.588315 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 07:48:47.593138 6749 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:47.594110 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260808 07:48:47.594504 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "11d5a578b72d4730ae93cb9d6a9237c3"
format_stamp: "Formatted at 2026-08-08 07:48:47 on dist-test-slave-pww0"
I20260808 07:48:47.594888 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:47.611881 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:47.613310 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:47.625751 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:47.626066 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:47.626356 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:47.626549 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:47.700750 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:40093
I20260808 07:48:47.700875 6877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:40093 every 8 connection(s)
I20260808 07:48:47.706799 6878 heartbeater.cc:344] Connected to a master server at 127.1.155.126:38197
I20260808 07:48:47.707257 6878 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:47.708186 6878 heartbeater.cc:507] Master 127.1.155.126:38197 requested a full tablet report, sending...
I20260808 07:48:47.710377 6634 ts_manager.cc:194] Registered new tserver with Master: 11d5a578b72d4730ae93cb9d6a9237c3 (127.1.155.65:40093)
I20260808 07:48:47.711134 1645 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006104883s
I20260808 07:48:47.712167 6634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47208
I20260808 07:48:47.748617 6810 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 07:48:47.750248 6810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:47.767518 6898 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: Bootstrap starting.
I20260808 07:48:47.772358 6898 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:47.776790 6898 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: No bootstrap required, opened a new log
I20260808 07:48:47.777205 6898 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260808 07:48:47.779214 6898 raft_consensus.cc:359] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } }
I20260808 07:48:47.779666 6898 raft_consensus.cc:385] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:47.779901 6898 raft_consensus.cc:740] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d5a578b72d4730ae93cb9d6a9237c3, State: Initialized, Role: FOLLOWER
I20260808 07:48:47.780503 6898 consensus_queue.cc:260] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } }
I20260808 07:48:47.780952 6898 raft_consensus.cc:399] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:47.781176 6898 raft_consensus.cc:493] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:47.781422 6898 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:47.786685 6898 raft_consensus.cc:515] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } }
I20260808 07:48:47.787220 6898 leader_election.cc:304] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11d5a578b72d4730ae93cb9d6a9237c3; no voters:
I20260808 07:48:47.788601 6898 leader_election.cc:290] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:47.789009 6900 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:47.790663 6878 heartbeater.cc:499] Master 127.1.155.126:38197 was elected leader, sending a full tablet report...
I20260808 07:48:47.791184 6898 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260808 07:48:47.791976 6900 raft_consensus.cc:697] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 1 LEADER]: Becoming Leader. State: Replica: 11d5a578b72d4730ae93cb9d6a9237c3, State: Running, Role: LEADER
I20260808 07:48:47.792588 6900 consensus_queue.cc:237] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } }
I20260808 07:48:47.796082 6903 tablet_replica.cc:442] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" committed_config { opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } } }
I20260808 07:48:47.796638 6903 tablet_replica.cc:445] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:47.798117 6904 tablet_replica.cc:442] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: TxnStatusTablet state changed. Reason: New leader 11d5a578b72d4730ae93cb9d6a9237c3. Latest consensus state: current_term: 1 leader_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" committed_config { opid_index: -1 peers { permanent_uuid: "11d5a578b72d4730ae93cb9d6a9237c3" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 40093 } } }
W20260808 07:48:47.798636 6634 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:47.798854 6904 tablet_replica.cc:445] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:47.804611 6906 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:48:47.805079 6906 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 07:48:47.807348 6634 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260808 07:48:47.861516 6778 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 07:48:47.861948 6778 txn_status_manager.cc:244] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 07:48:47.862435 6778 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260808 07:48:47.872517 6778 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 07:48:47.917402 6778 txn_status_manager.cc:244] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 07:48:47.917775 6778 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260808 07:48:47.927193 6778 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260808 07:48:47.938570 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.941066 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.943291 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.945575 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.947685 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.949690 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:45554
W20260808 07:48:47.960276 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
W20260808 07:48:47.962548 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
W20260808 07:48:47.964777 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
W20260808 07:48:47.966897 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
W20260808 07:48:47.969127 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
W20260808 07:48:47.971266 6810 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:45556
I20260808 07:48:47.974746 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:48.008095 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:48.008905 1645 tablet_replica.cc:333] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3: stopping tablet replica
I20260808 07:48:48.009487 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:48.009985 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 11d5a578b72d4730ae93cb9d6a9237c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:48.022996 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:48.038450 1645 master.cc:562] Master@127.1.155.126:38197 shutting down...
I20260808 07:48:48.060539 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:48.061087 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:48.061343 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 45937dcddc314e599bc8e24032df7afc: stopping tablet replica
I20260808 07:48:48.078840 1645 master.cc:584] Master@127.1.155.126:38197 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (764 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260808 07:48:48.101941 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:34141
I20260808 07:48:48.103008 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:48.108139 6922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.109189 6923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.110219 6926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:48.110606 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:48.111389 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:48.111610 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:48.111770 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175328111751 us; error 0 us; skew 500 ppm
I20260808 07:48:48.112306 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:48.114609 1645 webserver.cc:533] Webserver started at http://127.1.155.126:34233/ using document root <none> and password file <none>
I20260808 07:48:48.115100 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:48.115268 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:48.115639 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:48.116770 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "c4d52b89f7ae481393a588449a3500e7"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.121564 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 07:48:48.125295 6935 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:48.126046 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:48:48.126369 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "c4d52b89f7ae481393a588449a3500e7"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.126627 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:48.145074 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:48.146145 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:48.183435 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:34141
I20260808 07:48:48.183595 7021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:34141 every 8 connection(s)
I20260808 07:48:48.187253 7022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:48.198132 7022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7: Bootstrap starting.
I20260808 07:48:48.202952 7022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:48.207222 7022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7: No bootstrap required, opened a new log
I20260808 07:48:48.209312 7022 raft_consensus.cc:359] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER }
I20260808 07:48:48.209719 7022 raft_consensus.cc:385] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:48.209939 7022 raft_consensus.cc:740] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4d52b89f7ae481393a588449a3500e7, State: Initialized, Role: FOLLOWER
I20260808 07:48:48.210497 7022 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER }
I20260808 07:48:48.210942 7022 raft_consensus.cc:399] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:48.211145 7022 raft_consensus.cc:493] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:48.211386 7022 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:48.216177 7022 raft_consensus.cc:515] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER }
I20260808 07:48:48.216728 7022 leader_election.cc:304] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4d52b89f7ae481393a588449a3500e7; no voters:
I20260808 07:48:48.217933 7022 leader_election.cc:290] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:48.218286 7026 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:48.219631 7026 raft_consensus.cc:697] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 1 LEADER]: Becoming Leader. State: Replica: c4d52b89f7ae481393a588449a3500e7, State: Running, Role: LEADER
I20260808 07:48:48.220304 7026 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER }
I20260808 07:48:48.220853 7022 sys_catalog.cc:565] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:48.223596 7027 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4d52b89f7ae481393a588449a3500e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER } }
I20260808 07:48:48.223563 7028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4d52b89f7ae481393a588449a3500e7. Latest consensus state: current_term: 1 leader_uuid: "c4d52b89f7ae481393a588449a3500e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4d52b89f7ae481393a588449a3500e7" member_type: VOTER } }
I20260808 07:48:48.224355 7027 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:48.224529 7028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:48.229032 7034 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:48.234488 7034 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:48.238015 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:48.244125 7034 catalog_manager.cc:1383] Generated new cluster ID: beaa3251285748b9bf54afe8fb07bd2c
I20260808 07:48:48.244374 7034 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:48.266602 7034 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:48.267974 7034 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:48.282296 7034 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7: Generated new TSK 0
I20260808 07:48:48.282903 7034 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:48.305392 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:48.311311 7049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.312650 7050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:48.315786 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:48.315747 7052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:48.317713 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:48.317924 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:48.318068 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175328318054 us; error 0 us; skew 500 ppm
I20260808 07:48:48.318563 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:48.321053 1645 webserver.cc:533] Webserver started at http://127.1.155.65:44987/ using document root <none> and password file <none>
I20260808 07:48:48.321520 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:48.321682 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:48.321985 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:48.323114 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "0ffc118ae3f143109312f8268947f87e"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.328075 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 07:48:48.331818 7069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:48.332608 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:48:48.332976 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "0ffc118ae3f143109312f8268947f87e"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.333283 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:48.348603 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:48.349709 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:48.354815 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:48.355141 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:48.355448 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:48.355690 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 07:48:48.407225 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:42759
I20260808 07:48:48.407327 7184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:42759 every 8 connection(s)
I20260808 07:48:48.412055 7185 heartbeater.cc:344] Connected to a master server at 127.1.155.126:34141
I20260808 07:48:48.412415 7185 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:48.413106 7185 heartbeater.cc:507] Master 127.1.155.126:34141 requested a full tablet report, sending...
I20260808 07:48:48.415092 6964 ts_manager.cc:194] Registered new tserver with Master: 0ffc118ae3f143109312f8268947f87e (127.1.155.65:42759)
I20260808 07:48:48.415339 1645 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004958714s
I20260808 07:48:48.416831 6964 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38106
I20260808 07:48:48.447857 7129 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 07:48:48.449045 7129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:48.460521 7202 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: Bootstrap starting.
I20260808 07:48:48.464972 7202 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:48.469137 7202 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: No bootstrap required, opened a new log
I20260808 07:48:48.469553 7202 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260808 07:48:48.471527 7202 raft_consensus.cc:359] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.471930 7202 raft_consensus.cc:385] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:48.472147 7202 raft_consensus.cc:740] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ffc118ae3f143109312f8268947f87e, State: Initialized, Role: FOLLOWER
I20260808 07:48:48.472708 7202 consensus_queue.cc:260] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.473165 7202 raft_consensus.cc:399] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:48.473394 7202 raft_consensus.cc:493] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:48.473639 7202 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:48.478214 7202 raft_consensus.cc:515] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.478781 7202 leader_election.cc:304] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ffc118ae3f143109312f8268947f87e; no voters:
I20260808 07:48:48.479995 7202 leader_election.cc:290] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:48.480337 7204 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:48.481670 7204 raft_consensus.cc:697] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 1 LEADER]: Becoming Leader. State: Replica: 0ffc118ae3f143109312f8268947f87e, State: Running, Role: LEADER
I20260808 07:48:48.481880 7185 heartbeater.cc:499] Master 127.1.155.126:34141 was elected leader, sending a full tablet report...
I20260808 07:48:48.482419 7202 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260808 07:48:48.482442 7204 consensus_queue.cc:237] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.486409 7205 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ffc118ae3f143109312f8268947f87e" committed_config { opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } } }
I20260808 07:48:48.486907 7205 tablet_replica.cc:445] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:48.489064 7206 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: TxnStatusTablet state changed. Reason: New leader 0ffc118ae3f143109312f8268947f87e. Latest consensus state: current_term: 1 leader_uuid: "0ffc118ae3f143109312f8268947f87e" committed_config { opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } } }
I20260808 07:48:48.489648 7213 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:48:48.489653 7206 tablet_replica.cc:445] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:48:48.490319 7213 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 07:48:48.490752 6964 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260808 07:48:48.494871 6964 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 07:48:48.523829 7129 tablet_service.cc:1511] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 07:48:48.525045 7129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:48.536368 7202 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: Bootstrap starting.
I20260808 07:48:48.540925 7202 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:48.545296 7202 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: No bootstrap required, opened a new log
I20260808 07:48:48.545775 7202 ts_tablet_manager.cc:1403] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260808 07:48:48.547843 7202 raft_consensus.cc:359] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.548295 7202 raft_consensus.cc:385] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:48.548513 7202 raft_consensus.cc:740] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ffc118ae3f143109312f8268947f87e, State: Initialized, Role: FOLLOWER
I20260808 07:48:48.549116 7202 consensus_queue.cc:260] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.549592 7202 raft_consensus.cc:399] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:48.549818 7202 raft_consensus.cc:493] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:48.550071 7202 raft_consensus.cc:3060] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:48.555161 7202 raft_consensus.cc:515] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
I20260808 07:48:48.555779 7202 leader_election.cc:304] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ffc118ae3f143109312f8268947f87e; no voters:
I20260808 07:48:48.556262 7202 leader_election.cc:290] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:48.556465 7206 raft_consensus.cc:2804] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:48.556981 7206 raft_consensus.cc:697] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 1 LEADER]: Becoming Leader. State: Replica: 0ffc118ae3f143109312f8268947f87e, State: Running, Role: LEADER
I20260808 07:48:48.558001 7202 ts_tablet_manager.cc:1434] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260808 07:48:48.557716 7206 consensus_queue.cc:237] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ffc118ae3f143109312f8268947f87e" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 42759 } }
W20260808 07:48:48.563876 6964 catalog_manager.cc:5530] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260808 07:48:48.568336 6964 catalog_manager.cc:5530] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260808 07:48:48.586294 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:48.610929 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:48.611898 1645 tablet_replica.cc:333] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e: stopping tablet replica
I20260808 07:48:48.612725 1645 raft_consensus.cc:2243] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:48.613147 1645 raft_consensus.cc:2272] T 22222222222222222222222222222222 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:48.615756 1645 tablet_replica.cc:333] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e: stopping tablet replica
I20260808 07:48:48.616210 1645 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:48.616600 1645 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 0ffc118ae3f143109312f8268947f87e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:48.638190 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:48.650207 1645 master.cc:562] Master@127.1.155.126:34141 shutting down...
I20260808 07:48:48.664391 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:48.664942 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:48.665352 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P c4d52b89f7ae481393a588449a3500e7: stopping tablet replica
I20260808 07:48:48.684800 1645 master.cc:584] Master@127.1.155.126:34141 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (608 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3567 ms total)
[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/0
I20260808 07:48:48.711299 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:36317
I20260808 07:48:48.712524 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:48.717751 7226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.718935 7227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.720458 7230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:48.720731 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:48.721490 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:48.721678 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:48.721792 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175328721781 us; error 0 us; skew 500 ppm
I20260808 07:48:48.722271 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:48.724653 1645 webserver.cc:533] Webserver started at http://127.1.155.126:40439/ using document root <none> and password file <none>
I20260808 07:48:48.725109 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:48.725265 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:48.725477 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:48.726563 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "e2ceba6242d943ed8bcabacef65f5d1e"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.731227 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:48.734771 7238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:48.736615 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 07:48:48.736933 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "e2ceba6242d943ed8bcabacef65f5d1e"
format_stamp: "Formatted at 2026-08-08 07:48:48 on dist-test-slave-pww0"
I20260808 07:48:48.737217 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:48.762684 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:48.763813 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:48.800333 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:36317
I20260808 07:48:48.800436 7329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:36317 every 8 connection(s)
I20260808 07:48:48.804160 7331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:48.814939 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e: Bootstrap starting.
I20260808 07:48:48.819571 7331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:48.823796 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e: No bootstrap required, opened a new log
I20260808 07:48:48.825968 7331 raft_consensus.cc:359] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER }
I20260808 07:48:48.826400 7331 raft_consensus.cc:385] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:48.826637 7331 raft_consensus.cc:740] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ceba6242d943ed8bcabacef65f5d1e, State: Initialized, Role: FOLLOWER
I20260808 07:48:48.827207 7331 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER }
I20260808 07:48:48.827739 7331 raft_consensus.cc:399] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:48.827971 7331 raft_consensus.cc:493] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:48.828220 7331 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:48.833582 7331 raft_consensus.cc:515] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER }
I20260808 07:48:48.834131 7331 leader_election.cc:304] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2ceba6242d943ed8bcabacef65f5d1e; no voters:
I20260808 07:48:48.835328 7331 leader_election.cc:290] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:48.835743 7336 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:48.837153 7336 raft_consensus.cc:697] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 1 LEADER]: Becoming Leader. State: Replica: e2ceba6242d943ed8bcabacef65f5d1e, State: Running, Role: LEADER
I20260808 07:48:48.837857 7336 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER }
I20260808 07:48:48.838383 7331 sys_catalog.cc:565] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:48.841027 7339 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER } }
I20260808 07:48:48.841063 7340 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ceba6242d943ed8bcabacef65f5d1e. Latest consensus state: current_term: 1 leader_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ceba6242d943ed8bcabacef65f5d1e" member_type: VOTER } }
I20260808 07:48:48.841979 7339 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:48.841971 7340 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:48.845559 7345 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:48.850414 7345 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:48.857380 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:48.859164 7345 catalog_manager.cc:1383] Generated new cluster ID: 323199c2580845cbaf38daa7c0a1e1dc
I20260808 07:48:48.859488 7345 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:48.911657 7345 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:48.913039 7345 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:48.928493 7345 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e: Generated new TSK 0
I20260808 07:48:48.929141 7345 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:48.988709 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:48.995301 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.996853 7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:48.997756 7369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:48.999886 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:49.000658 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:49.000861 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:49.000996 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175329000984 us; error 0 us; skew 500 ppm
I20260808 07:48:49.001495 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:49.003890 1645 webserver.cc:533] Webserver started at http://127.1.155.65:37645/ using document root <none> and password file <none>
I20260808 07:48:49.004339 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:49.004498 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:49.004706 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:49.005786 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "121bb57c1bce461da7b3c936022449d8"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.010572 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 07:48:49.014045 7381 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.014825 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:49.015082 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "121bb57c1bce461da7b3c936022449d8"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.015344 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:49.056239 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:49.057675 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:49.059118 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:49.061538 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:49.061744 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.062003 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:49.062150 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.100811 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:45751
I20260808 07:48:49.100912 7496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:45751 every 8 connection(s)
I20260808 07:48:49.105683 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:49.112572 7506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:49.114953 7507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:49.116187 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:49.116983 7511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:49.117898 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260808 07:48:49.118010 7498 heartbeater.cc:344] Connected to a master server at 127.1.155.126:36317
W20260808 07:48:49.118104 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:49.118489 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175329118467 us; error 0 us; skew 500 ppm
I20260808 07:48:49.118535 7498 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:49.119067 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:49.119331 7498 heartbeater.cc:507] Master 127.1.155.126:36317 requested a full tablet report, sending...
I20260808 07:48:49.121531 7260 ts_manager.cc:194] Registered new tserver with Master: 121bb57c1bce461da7b3c936022449d8 (127.1.155.65:45751)
I20260808 07:48:49.121783 1645 webserver.cc:533] Webserver started at http://127.1.155.66:40499/ using document root <none> and password file <none>
I20260808 07:48:49.122345 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:49.122534 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:49.122803 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:49.123474 7260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57572
I20260808 07:48:49.124034 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "0611a7201b7b4b05bd67e9076ba33af9"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.136216 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.011s user 0.006s sys 0.006s
I20260808 07:48:49.140056 7517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.140862 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260808 07:48:49.141158 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "0611a7201b7b4b05bd67e9076ba33af9"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.141451 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:49.161499 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:49.162636 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:49.164119 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:49.166342 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:49.166539 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.166764 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:49.166913 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.205082 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:39923
I20260808 07:48:49.205199 7615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:39923 every 8 connection(s)
I20260808 07:48:49.209789 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:49.216827 7619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:49.218194 7621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:49.221006 7623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:49.221975 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:49.222493 7616 heartbeater.cc:344] Connected to a master server at 127.1.155.126:36317
I20260808 07:48:49.222865 7616 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:49.222918 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:49.223205 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:49.223379 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175329223360 us; error 0 us; skew 500 ppm
I20260808 07:48:49.223671 7616 heartbeater.cc:507] Master 127.1.155.126:36317 requested a full tablet report, sending...
I20260808 07:48:49.224022 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:49.225668 7260 ts_manager.cc:194] Registered new tserver with Master: 0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923)
I20260808 07:48:49.226719 1645 webserver.cc:533] Webserver started at http://127.1.155.67:39273/ using document root <none> and password file <none>
I20260808 07:48:49.227231 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:49.227182 7260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57574
I20260808 07:48:49.227645 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:49.227939 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:49.229215 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root/instance:
uuid: "3f065c03432d4bbabbb08cd7394ab2ba"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.233843 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 07:48:49.237332 7632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.238065 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:48:49.238353 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root
uuid: "3f065c03432d4bbabbb08cd7394ab2ba"
format_stamp: "Formatted at 2026-08-08 07:48:49 on dist-test-slave-pww0"
I20260808 07:48:49.238663 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:49.262758 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:49.263908 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:49.265403 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:49.267660 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:49.267868 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.268110 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:49.268244 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:49.306577 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.67:38385
I20260808 07:48:49.306691 7737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.67:38385 every 8 connection(s)
I20260808 07:48:49.320247 7738 heartbeater.cc:344] Connected to a master server at 127.1.155.126:36317
I20260808 07:48:49.320670 7738 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:49.321391 7738 heartbeater.cc:507] Master 127.1.155.126:36317 requested a full tablet report, sending...
I20260808 07:48:49.323437 7260 ts_manager.cc:194] Registered new tserver with Master: 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385)
I20260808 07:48:49.323604 1645 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013938629s
I20260808 07:48:49.325026 7260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57582
I20260808 07:48:49.365655 7260 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57606:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:48:49.410138 7687 tablet_service.cc:1511] Processing CreateTablet for tablet 7da165d8aed841b5b3209380c2dd0a7c (DEFAULT_TABLE table=test-workload [id=360cfd564fe14c8abcf940e388deec03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:49.411556 7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da165d8aed841b5b3209380c2dd0a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:49.416564 7436 tablet_service.cc:1511] Processing CreateTablet for tablet 7da165d8aed841b5b3209380c2dd0a7c (DEFAULT_TABLE table=test-workload [id=360cfd564fe14c8abcf940e388deec03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:49.417948 7436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da165d8aed841b5b3209380c2dd0a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:49.418957 7553 tablet_service.cc:1511] Processing CreateTablet for tablet 7da165d8aed841b5b3209380c2dd0a7c (DEFAULT_TABLE table=test-workload [id=360cfd564fe14c8abcf940e388deec03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:49.420320 7553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da165d8aed841b5b3209380c2dd0a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:49.428050 7777 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Bootstrap starting.
I20260808 07:48:49.433844 7778 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Bootstrap starting.
I20260808 07:48:49.435351 7777 tablet_bootstrap.cc:654] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:49.440794 7779 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: Bootstrap starting.
I20260808 07:48:49.441968 7778 tablet_bootstrap.cc:654] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:49.442804 7777 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: No bootstrap required, opened a new log
I20260808 07:48:49.443403 7777 ts_tablet_manager.cc:1403] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.007s
I20260808 07:48:49.446770 7778 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: No bootstrap required, opened a new log
I20260808 07:48:49.446686 7777 raft_consensus.cc:359] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.447266 7778 ts_tablet_manager.cc:1403] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.005s
I20260808 07:48:49.447536 7777 raft_consensus.cc:385] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:49.447852 7779 tablet_bootstrap.cc:654] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:49.447917 7777 raft_consensus.cc:740] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f065c03432d4bbabbb08cd7394ab2ba, State: Initialized, Role: FOLLOWER
I20260808 07:48:49.448802 7777 consensus_queue.cc:260] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.449780 7778 raft_consensus.cc:359] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.451504 7738 heartbeater.cc:499] Master 127.1.155.126:36317 was elected leader, sending a full tablet report...
I20260808 07:48:49.452075 7777 ts_tablet_manager.cc:1434] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260808 07:48:49.450381 7778 raft_consensus.cc:385] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:49.452741 7778 raft_consensus.cc:740] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 121bb57c1bce461da7b3c936022449d8, State: Initialized, Role: FOLLOWER
I20260808 07:48:49.453722 7778 consensus_queue.cc:260] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.456918 7779 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: No bootstrap required, opened a new log
I20260808 07:48:49.457499 7779 ts_tablet_manager.cc:1403] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20260808 07:48:49.458336 7498 heartbeater.cc:499] Master 127.1.155.126:36317 was elected leader, sending a full tablet report...
I20260808 07:48:49.458832 7778 ts_tablet_manager.cc:1434] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260808 07:48:49.460492 7779 raft_consensus.cc:359] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.461238 7779 raft_consensus.cc:385] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:49.461526 7779 raft_consensus.cc:740] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0611a7201b7b4b05bd67e9076ba33af9, State: Initialized, Role: FOLLOWER
I20260808 07:48:49.462285 7779 consensus_queue.cc:260] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.470793 7616 heartbeater.cc:499] Master 127.1.155.126:36317 was elected leader, sending a full tablet report...
I20260808 07:48:49.471391 7779 ts_tablet_manager.cc:1434] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260808 07:48:49.712356 7787 raft_consensus.cc:493] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:49.712894 7787 raft_consensus.cc:515] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.714954 7787 leader_election.cc:290] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385), 0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923)
I20260808 07:48:49.725782 7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da165d8aed841b5b3209380c2dd0a7c" candidate_uuid: "121bb57c1bce461da7b3c936022449d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" is_pre_election: true
I20260808 07:48:49.726377 7569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da165d8aed841b5b3209380c2dd0a7c" candidate_uuid: "121bb57c1bce461da7b3c936022449d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611a7201b7b4b05bd67e9076ba33af9" is_pre_election: true
I20260808 07:48:49.726472 7703 raft_consensus.cc:2468] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121bb57c1bce461da7b3c936022449d8 in term 0.
I20260808 07:48:49.727217 7569 raft_consensus.cc:2468] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121bb57c1bce461da7b3c936022449d8 in term 0.
I20260808 07:48:49.727969 7383 leader_election.cc:304] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121bb57c1bce461da7b3c936022449d8, 3f065c03432d4bbabbb08cd7394ab2ba; no voters:
I20260808 07:48:49.729132 7787 raft_consensus.cc:2804] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:49.729506 7787 raft_consensus.cc:493] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:49.729820 7787 raft_consensus.cc:3060] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:49.736075 7787 raft_consensus.cc:515] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.737991 7787 leader_election.cc:290] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [CANDIDATE]: Term 1 election: Requested vote from peers 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385), 0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923)
I20260808 07:48:49.739055 7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da165d8aed841b5b3209380c2dd0a7c" candidate_uuid: "121bb57c1bce461da7b3c936022449d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f065c03432d4bbabbb08cd7394ab2ba"
I20260808 07:48:49.739252 7569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da165d8aed841b5b3209380c2dd0a7c" candidate_uuid: "121bb57c1bce461da7b3c936022449d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611a7201b7b4b05bd67e9076ba33af9"
I20260808 07:48:49.739607 7703 raft_consensus.cc:3060] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:49.739841 7569 raft_consensus.cc:3060] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:49.745054 7703 raft_consensus.cc:2468] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121bb57c1bce461da7b3c936022449d8 in term 1.
I20260808 07:48:49.745306 7569 raft_consensus.cc:2468] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121bb57c1bce461da7b3c936022449d8 in term 1.
I20260808 07:48:49.746312 7383 leader_election.cc:304] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121bb57c1bce461da7b3c936022449d8, 3f065c03432d4bbabbb08cd7394ab2ba; no voters:
I20260808 07:48:49.747030 7787 raft_consensus.cc:2804] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:49.748039 7787 raft_consensus.cc:697] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 LEADER]: Becoming Leader. State: Replica: 121bb57c1bce461da7b3c936022449d8, State: Running, Role: LEADER
I20260808 07:48:49.748778 7787 consensus_queue.cc:237] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:49.755192 7258 catalog_manager.cc:5697] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 121bb57c1bce461da7b3c936022449d8 (127.1.155.65). New cstate: current_term: 1 leader_uuid: "121bb57c1bce461da7b3c936022449d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } }
I20260808 07:48:50.047710 7553 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:50.057550 7436 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 07:48:50.065290 7687 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:50.265029 7844 consensus_queue.cc:1048] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e2ceba6242d943ed8bcabacef65f5d1e | 127.1.155.126:36317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
I20260808 07:48:50.279943 7844 consensus_queue.cc:1048] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
0611a7201b7b4b05bd67e9076ba33af9 | 127.1.155.66:39923 | HEALTHY | <none> | 0 | 0
121bb57c1bce461da7b3c936022449d8 | 127.1.155.65:45751 | HEALTHY | <none> | 1 | 0
3f065c03432d4bbabbb08cd7394ab2ba | 127.1.155.67:38385 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7da165d8aed841b5b3209380c2dd0a7c of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): RUNNING
121bb57c1bce461da7b3c936022449d8 (127.1.155.65:45751): RUNNING [LEADER]
0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923): RUNNING
All reported replicas are:
A = 3f065c03432d4bbabbb08cd7394ab2ba
B = 121bb57c1bce461da7b3c936022449d8
C = 0611a7201b7b4b05bd67e9076ba33af9
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:50.292353 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:50.681738 7436 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 07:48:50.684827 7687 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:50.687386 7553 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e2ceba6242d943ed8bcabacef65f5d1e | 127.1.155.126:36317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
0611a7201b7b4b05bd67e9076ba33af9 | 127.1.155.66:39923 | HEALTHY | <none> | 0 | 0
121bb57c1bce461da7b3c936022449d8 | 127.1.155.65:45751 | HEALTHY | <none> | 1 | 0
3f065c03432d4bbabbb08cd7394ab2ba | 127.1.155.67:38385 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 07:48:50.917594 1645 log_verifier.cc:126] Checking tablet 7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:50.982394 1645 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:50.983006 1645 tablet_replica.cc:333] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: stopping tablet replica
I20260808 07:48:50.983615 1645 raft_consensus.cc:2243] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:50.984114 1645 raft_consensus.cc:2272] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:51.221799 7553 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:51.232146 7687 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:51.234265 7436 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260808 07:48:51.242141 7383 consensus_peers.cc:597] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 -> Peer 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): Couldn't send request to peer 3f065c03432d4bbabbb08cd7394ab2ba. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:51.243449 7844 raft_consensus.cc:1012] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Attempting to remove follower 3f065c03432d4bbabbb08cd7394ab2ba from the Raft config. Reason: The tablet replica hosted on peer 3f065c03432d4bbabbb08cd7394ab2ba has failed
I20260808 07:48:51.246078 7844 consensus_queue.cc:237] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } }
I20260808 07:48:51.250849 7569 raft_consensus.cc:1275] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Refusing update from remote peer 121bb57c1bce461da7b3c936022449d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:48:51.252255 7944 consensus_queue.cc:1048] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 07:48:51.258414 7844 raft_consensus.cc:2955] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } }
I20260808 07:48:51.260063 7569 raft_consensus.cc:2955] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } }
I20260808 07:48:51.274729 7260 catalog_manager.cc:5697] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 reported cstate change: config changed from index -1 to 2, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) evicted. New cstate: current_term: 1 leader_uuid: "121bb57c1bce461da7b3c936022449d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } }
I20260808 07:48:51.328509 7455 consensus_queue.cc:237] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } }
I20260808 07:48:51.331758 7687 tablet_service.cc:1558] Processing DeleteTablet for tablet 7da165d8aed841b5b3209380c2dd0a7c with delete_type TABLET_DATA_TOMBSTONED (TS 3f065c03432d4bbabbb08cd7394ab2ba not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:51888
I20260808 07:48:51.334070 7953 ts_tablet_manager.cc:1916] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260808 07:48:51.339411 7383 consensus_peers.cc:597] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 -> Peer 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): Couldn't send request to peer 3f065c03432d4bbabbb08cd7394ab2ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:51.342787 7569 raft_consensus.cc:1275] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Refusing update from remote peer 121bb57c1bce461da7b3c936022449d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260808 07:48:51.345113 7844 consensus_queue.cc:1048] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:51.351135 7953 ts_tablet_manager.cc:1929] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260808 07:48:51.351693 7953 log.cc:1199] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786175273611720-1645-0/minicluster-data/ts-2-root/wals/7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:51.353363 7239 catalog_manager.cc:5028] TS 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): tablet 7da165d8aed841b5b3209380c2dd0a7c (table test-workload [id=360cfd564fe14c8abcf940e388deec03]) successfully deleted
I20260808 07:48:51.353694 7844 raft_consensus.cc:2955] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } }
I20260808 07:48:51.355176 7569 raft_consensus.cc:2955] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } }
I20260808 07:48:51.361939 7240 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 7da165d8aed841b5b3209380c2dd0a7c with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260808 07:48:51.364940 7260 catalog_manager.cc:5697] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 reported cstate change: config changed from index 2 to 3, VOTER 3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67) added. New cstate: current_term: 1 leader_uuid: "121bb57c1bce461da7b3c936022449d8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } } }
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e2ceba6242d943ed8bcabacef65f5d1e | 127.1.155.126:36317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
0611a7201b7b4b05bd67e9076ba33af9 | 127.1.155.66:39923 | HEALTHY | <none> | 0 | 0
121bb57c1bce461da7b3c936022449d8 | 127.1.155.65:45751 | HEALTHY | <none> | 1 | 0
3f065c03432d4bbabbb08cd7394ab2ba | 127.1.155.67:38385 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7da165d8aed841b5b3209380c2dd0a7c of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
121bb57c1bce461da7b3c936022449d8 (127.1.155.65:45751): RUNNING [LEADER]
0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923): RUNNING
All reported replicas are:
A = 3f065c03432d4bbabbb08cd7394ab2ba
B = 121bb57c1bce461da7b3c936022449d8
C = 0611a7201b7b4b05bd67e9076ba33af9
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | [config not available] | | |
B | A B* C | 1 | -1 | Yes
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:51.491828 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:51.861801 7553 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:51.867652 7436 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 07:48:51.871289 7687 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:51.875898 7996 ts_tablet_manager.cc:933] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Initiating tablet copy from peer 121bb57c1bce461da7b3c936022449d8 (127.1.155.65:45751)
I20260808 07:48:51.898296 7996 tablet_copy_client.cc:323] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet copy: Beginning tablet copy session from remote peer at address 127.1.155.65:45751
I20260808 07:48:51.928110 7474 tablet_copy_service.cc:140] P 121bb57c1bce461da7b3c936022449d8: Received BeginTabletCopySession request for tablet 7da165d8aed841b5b3209380c2dd0a7c from peer 3f065c03432d4bbabbb08cd7394ab2ba ({username='slave'} at 127.0.0.1:39106)
I20260808 07:48:51.928800 7474 tablet_copy_service.cc:161] P 121bb57c1bce461da7b3c936022449d8: Beginning new tablet copy session on tablet 7da165d8aed841b5b3209380c2dd0a7c from peer 3f065c03432d4bbabbb08cd7394ab2ba at {username='slave'} at 127.0.0.1:39106: session id = 3f065c03432d4bbabbb08cd7394ab2ba-7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:51.937177 7474 tablet_copy_source_session.cc:215] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:48:51.940570 7996 ts_tablet_manager.cc:1916] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260808 07:48:51.958684 7996 ts_tablet_manager.cc:1929] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260808 07:48:51.959688 7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da165d8aed841b5b3209380c2dd0a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:51.969099 7996 tablet_copy_client.cc:806] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet copy: Starting download of 0 data blocks...
I20260808 07:48:51.969841 7996 tablet_copy_client.cc:670] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet copy: Starting download of 1 WAL segments...
I20260808 07:48:51.974602 7996 tablet_copy_client.cc:538] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:48:51.984746 7996 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Bootstrap starting.
I20260808 07:48:52.016806 7996 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:48:52.018090 7996 tablet_bootstrap.cc:492] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Bootstrap complete.
I20260808 07:48:52.018962 7996 ts_tablet_manager.cc:1403] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Time spent bootstrapping tablet: real 0.034s user 0.020s sys 0.014s
I20260808 07:48:52.022105 7996 raft_consensus.cc:359] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } }
I20260808 07:48:52.023119 7996 raft_consensus.cc:740] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f065c03432d4bbabbb08cd7394ab2ba, State: Initialized, Role: FOLLOWER
I20260808 07:48:52.024292 7996 consensus_queue.cc:260] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "121bb57c1bce461da7b3c936022449d8" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 45751 } } peers { permanent_uuid: "0611a7201b7b4b05bd67e9076ba33af9" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 39923 } } peers { permanent_uuid: "3f065c03432d4bbabbb08cd7394ab2ba" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 38385 } }
I20260808 07:48:52.033639 7996 ts_tablet_manager.cc:1434] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260808 07:48:52.035631 7474 tablet_copy_service.cc:342] P 121bb57c1bce461da7b3c936022449d8: Request end of tablet copy session 3f065c03432d4bbabbb08cd7394ab2ba-7da165d8aed841b5b3209380c2dd0a7c received from {username='slave'} at 127.0.0.1:39106
I20260808 07:48:52.036063 7474 tablet_copy_service.cc:434] P 121bb57c1bce461da7b3c936022449d8: ending tablet copy session 3f065c03432d4bbabbb08cd7394ab2ba-7da165d8aed841b5b3209380c2dd0a7c on tablet 7da165d8aed841b5b3209380c2dd0a7c with peer 3f065c03432d4bbabbb08cd7394ab2ba
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e2ceba6242d943ed8bcabacef65f5d1e | 127.1.155.126:36317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
0611a7201b7b4b05bd67e9076ba33af9 | 127.1.155.66:39923 | HEALTHY | <none> | 0 | 0
121bb57c1bce461da7b3c936022449d8 | 127.1.155.65:45751 | HEALTHY | <none> | 1 | 0
3f065c03432d4bbabbb08cd7394ab2ba | 127.1.155.67:38385 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 7da165d8aed841b5b3209380c2dd0a7c of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
121bb57c1bce461da7b3c936022449d8 (127.1.155.65:45751): RUNNING [LEADER]
0611a7201b7b4b05bd67e9076ba33af9 (127.1.155.66:39923): RUNNING
3f065c03432d4bbabbb08cd7394ab2ba (127.1.155.67:38385): not running
State: FAILED
Data state: TABLET_DATA_TOMBSTONED
Last status: Deleted tablet blocks from disk
All reported replicas are:
A = 121bb57c1bce461da7b3c936022449d8
B = 0611a7201b7b4b05bd67e9076ba33af9
C = 3f065c03432d4bbabbb08cd7394ab2ba
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 1 | 3 | Yes
B | A* B C | 1 | 3 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:52.098511 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:52.451879 7703 raft_consensus.cc:1217] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3] Dedup: 1.3->[]
I20260808 07:48:52.554771 7553 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:52.555588 7687 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:52.556298 7436 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e2ceba6242d943ed8bcabacef65f5d1e | 127.1.155.126:36317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
0611a7201b7b4b05bd67e9076ba33af9 | 127.1.155.66:39923 | HEALTHY | <none> | 0 | 0
121bb57c1bce461da7b3c936022449d8 | 127.1.155.65:45751 | HEALTHY | <none> | 1 | 0
3f065c03432d4bbabbb08cd7394ab2ba | 127.1.155.67:38385 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 07:48:52.782016 1645 log_verifier.cc:126] Checking tablet 7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:52.843210 1645 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 7da165d8aed841b5b3209380c2dd0a7c
I20260808 07:48:52.845373 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:52.868944 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:52.869572 1645 tablet_replica.cc:333] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8: stopping tablet replica
I20260808 07:48:52.870051 1645 raft_consensus.cc:2243] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:52.870926 1645 raft_consensus.cc:2272] T 7da165d8aed841b5b3209380c2dd0a7c P 121bb57c1bce461da7b3c936022449d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:52.891218 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:52.901242 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:52.919921 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:52.920558 1645 tablet_replica.cc:333] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9: stopping tablet replica
I20260808 07:48:52.921054 1645 raft_consensus.cc:2243] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:52.921518 1645 raft_consensus.cc:2272] T 7da165d8aed841b5b3209380c2dd0a7c P 0611a7201b7b4b05bd67e9076ba33af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:52.941689 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:52.951210 1645 tablet_server.cc:179] TabletServer@127.1.155.67:0 shutting down...
I20260808 07:48:52.969467 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:52.970100 1645 tablet_replica.cc:333] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba: stopping tablet replica
I20260808 07:48:52.970621 1645 raft_consensus.cc:2243] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:52.971006 1645 raft_consensus.cc:2272] T 7da165d8aed841b5b3209380c2dd0a7c P 3f065c03432d4bbabbb08cd7394ab2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:52.990432 1645 tablet_server.cc:196] TabletServer@127.1.155.67:0 shutdown complete.
I20260808 07:48:53.000188 1645 master.cc:562] Master@127.1.155.126:36317 shutting down...
I20260808 07:48:53.016376 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:53.016957 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:53.017423 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P e2ceba6242d943ed8bcabacef65f5d1e: stopping tablet replica
I20260808 07:48:53.035293 1645 master.cc:584] Master@127.1.155.126:36317 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/0 (4352 ms)
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/1
I20260808 07:48:53.063086 1645 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.155.126:38509
I20260808 07:48:53.064204 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:53.069706 8063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.070910 8064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.073449 8068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.073529 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:53.074821 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:53.075012 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:53.075183 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175333075166 us; error 0 us; skew 500 ppm
I20260808 07:48:53.075757 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:53.077991 1645 webserver.cc:533] Webserver started at http://127.1.155.126:36705/ using document root <none> and password file <none>
I20260808 07:48:53.078470 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:53.078641 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:53.078902 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:53.080047 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/master-0-root/instance:
uuid: "853217b72ebd48419bf853350c5570cf"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.084636 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 07:48:53.088282 8074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.089196 1645 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 07:48:53.089622 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/master-0-root
uuid: "853217b72ebd48419bf853350c5570cf"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.089937 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:53.100629 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:53.101720 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:53.142979 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.126:38509
I20260808 07:48:53.143078 8160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.126:38509 every 8 connection(s)
I20260808 07:48:53.146973 8161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:53.158037 8161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf: Bootstrap starting.
I20260808 07:48:53.162676 8161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:53.166949 8161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf: No bootstrap required, opened a new log
I20260808 07:48:53.169083 8161 raft_consensus.cc:359] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER }
I20260808 07:48:53.169497 8161 raft_consensus.cc:385] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:53.169679 8161 raft_consensus.cc:740] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 853217b72ebd48419bf853350c5570cf, State: Initialized, Role: FOLLOWER
I20260808 07:48:53.170224 8161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER }
I20260808 07:48:53.170727 8161 raft_consensus.cc:399] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:48:53.170926 8161 raft_consensus.cc:493] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:48:53.171128 8161 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:53.175904 8161 raft_consensus.cc:515] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER }
I20260808 07:48:53.176424 8161 leader_election.cc:304] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 853217b72ebd48419bf853350c5570cf; no voters:
I20260808 07:48:53.177529 8161 leader_election.cc:290] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:48:53.177888 8164 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:53.179284 8164 raft_consensus.cc:697] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 1 LEADER]: Becoming Leader. State: Replica: 853217b72ebd48419bf853350c5570cf, State: Running, Role: LEADER
I20260808 07:48:53.179939 8164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER }
I20260808 07:48:53.180609 8161 sys_catalog.cc:565] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:48:53.184062 8165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "853217b72ebd48419bf853350c5570cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER } }
I20260808 07:48:53.185036 8165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:53.185561 8166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 853217b72ebd48419bf853350c5570cf. Latest consensus state: current_term: 1 leader_uuid: "853217b72ebd48419bf853350c5570cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853217b72ebd48419bf853350c5570cf" member_type: VOTER } }
I20260808 07:48:53.186158 8166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [sys.catalog]: This master's current role is: LEADER
I20260808 07:48:53.188443 8171 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 07:48:53.193996 8171 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 07:48:53.196107 1645 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 07:48:53.203114 8171 catalog_manager.cc:1383] Generated new cluster ID: 8f72ebd14e1a4a72b0ef18d4e37926a2
I20260808 07:48:53.203449 8171 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 07:48:53.229717 8171 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 07:48:53.231067 8171 catalog_manager.cc:1540] Loading token signing keys...
I20260808 07:48:53.254357 8171 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf: Generated new TSK 0
I20260808 07:48:53.255021 8171 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 07:48:53.262547 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:53.268545 8191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.269475 8192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.271550 1645 server_base.cc:1061] running on GCE node
W20260808 07:48:53.271966 8195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.272967 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:53.273162 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:53.273336 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175333273316 us; error 0 us; skew 500 ppm
I20260808 07:48:53.273849 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:53.276212 1645 webserver.cc:533] Webserver started at http://127.1.155.65:42717/ using document root <none> and password file <none>
I20260808 07:48:53.276677 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:53.276859 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:53.277107 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:53.278185 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-0-root/instance:
uuid: "dd05455992da474c8cc9aae58037b6ee"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.282814 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:53.286288 8202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.287072 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:53.287384 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-0-root
uuid: "dd05455992da474c8cc9aae58037b6ee"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.287708 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:53.308714 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:53.309784 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:53.311300 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:53.313853 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:53.314064 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.314291 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:53.314440 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.354247 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.65:33741
I20260808 07:48:53.354372 8298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.65:33741 every 8 connection(s)
I20260808 07:48:53.359340 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:53.366739 8304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.367780 8305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.372397 8309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.372483 8299 heartbeater.cc:344] Connected to a master server at 127.1.155.126:38509
I20260808 07:48:53.372910 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:53.373050 8299 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:53.374289 8299 heartbeater.cc:507] Master 127.1.155.126:38509 requested a full tablet report, sending...
I20260808 07:48:53.374521 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:53.374750 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:53.374907 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175333374892 us; error 0 us; skew 500 ppm
I20260808 07:48:53.375650 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:53.376448 8096 ts_manager.cc:194] Registered new tserver with Master: dd05455992da474c8cc9aae58037b6ee (127.1.155.65:33741)
I20260808 07:48:53.378141 1645 webserver.cc:533] Webserver started at http://127.1.155.66:42357/ using document root <none> and password file <none>
I20260808 07:48:53.378471 8096 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60976
I20260808 07:48:53.378635 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:53.378921 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:53.379187 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:53.380394 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-1-root/instance:
uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.384938 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 07:48:53.388413 8315 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.389293 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:48:53.389587 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-1-root
uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.389915 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:53.406580 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:53.407667 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:53.409132 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:53.411484 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:53.411695 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.411922 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:53.412081 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.450335 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.66:32949
I20260808 07:48:53.450440 8419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.66:32949 every 8 connection(s)
I20260808 07:48:53.455170 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:53.462523 8426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.462606 8427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.466411 8429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.466609 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:53.467411 8420 heartbeater.cc:344] Connected to a master server at 127.1.155.126:38509
I20260808 07:48:53.467708 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260808 07:48:53.467833 8420 heartbeater.cc:461] Registering TS with master...
W20260808 07:48:53.467954 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:53.468189 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175333468173 us; error 0 us; skew 500 ppm
I20260808 07:48:53.468681 8420 heartbeater.cc:507] Master 127.1.155.126:38509 requested a full tablet report, sending...
I20260808 07:48:53.468775 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:53.470877 8096 ts_manager.cc:194] Registered new tserver with Master: 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66:32949)
I20260808 07:48:53.471351 1645 webserver.cc:533] Webserver started at http://127.1.155.67:36235/ using document root <none> and password file <none>
I20260808 07:48:53.471889 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:53.472084 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:53.472329 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:53.472401 8096 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60982
I20260808 07:48:53.473484 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-2-root/instance:
uuid: "6cb1aae7502b4639b7e9fbfe4884af54"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.478119 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 07:48:53.481648 8441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.482587 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:48:53.482905 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-2-root
uuid: "6cb1aae7502b4639b7e9fbfe4884af54"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.483166 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:53.518479 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:53.519712 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:53.521212 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:53.523603 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:53.523810 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.524042 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:53.524204 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.566490 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.67:41683
I20260808 07:48:53.566642 8534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.67:41683 every 8 connection(s)
I20260808 07:48:53.571270 1645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 07:48:53.577718 8541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:48:53.578987 8544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.582600 1645 server_base.cc:1061] running on GCE node
I20260808 07:48:53.583562 8538 heartbeater.cc:344] Connected to a master server at 127.1.155.126:38509
I20260808 07:48:53.583983 8538 heartbeater.cc:461] Registering TS with master...
W20260808 07:48:53.584254 8546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:48:53.584944 8538 heartbeater.cc:507] Master 127.1.155.126:38509 requested a full tablet report, sending...
I20260808 07:48:53.585163 1645 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 07:48:53.585438 1645 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 07:48:53.585600 1645 hybrid_clock.cc:648] HybridClock initialized: now 1786175333585585 us; error 0 us; skew 500 ppm
I20260808 07:48:53.586248 1645 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 07:48:53.587247 8096 ts_manager.cc:194] Registered new tserver with Master: 6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683)
I20260808 07:48:53.589076 1645 webserver.cc:533] Webserver started at http://127.1.155.68:35487/ using document root <none> and password file <none>
I20260808 07:48:53.589103 8096 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60986
I20260808 07:48:53.589937 1645 fs_manager.cc:362] Metadata directory not provided
I20260808 07:48:53.590224 1645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:48:53.590585 1645 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:48:53.592060 1645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root/instance:
uuid: "7264b602a0e244e0b45f52e1ad5a551d"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.596693 1645 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 07:48:53.600252 8555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.601078 1645 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260808 07:48:53.601380 1645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root
uuid: "7264b602a0e244e0b45f52e1ad5a551d"
format_stamp: "Formatted at 2026-08-08 07:48:53 on dist-test-slave-pww0"
I20260808 07:48:53.601668 1645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:48:53.624264 1645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 07:48:53.625332 1645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:48:53.626852 1645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 07:48:53.629328 1645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:48:53.629541 1645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.629784 1645 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 07:48:53.629941 1645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:48:53.670712 1645 rpc_server.cc:307] RPC server started. Bound to: 127.1.155.68:39385
I20260808 07:48:53.670827 8649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.155.68:39385 every 8 connection(s)
I20260808 07:48:53.684289 8652 heartbeater.cc:344] Connected to a master server at 127.1.155.126:38509
I20260808 07:48:53.684720 8652 heartbeater.cc:461] Registering TS with master...
I20260808 07:48:53.685531 8652 heartbeater.cc:507] Master 127.1.155.126:38509 requested a full tablet report, sending...
I20260808 07:48:53.687711 8096 ts_manager.cc:194] Registered new tserver with Master: 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385)
I20260808 07:48:53.688189 1645 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01432061s
I20260808 07:48:53.689548 8096 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60998
I20260808 07:48:53.733318 8096 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32782:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:48:53.778656 8249 tablet_service.cc:1511] Processing CreateTablet for tablet f08556ea7e104267ac582029b6c23b2d (DEFAULT_TABLE table=test-workload [id=970ef48d9d6c4c24a9485e83ca6a30d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:53.780055 8249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08556ea7e104267ac582029b6c23b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:53.787086 8488 tablet_service.cc:1511] Processing CreateTablet for tablet f08556ea7e104267ac582029b6c23b2d (DEFAULT_TABLE table=test-workload [id=970ef48d9d6c4c24a9485e83ca6a30d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:53.787662 8597 tablet_service.cc:1511] Processing CreateTablet for tablet f08556ea7e104267ac582029b6c23b2d (DEFAULT_TABLE table=test-workload [id=970ef48d9d6c4c24a9485e83ca6a30d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:48:53.788499 8488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08556ea7e104267ac582029b6c23b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:53.788720 8597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08556ea7e104267ac582029b6c23b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:53.797669 8684 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: Bootstrap starting.
I20260808 07:48:53.804916 8686 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: Bootstrap starting.
I20260808 07:48:53.804996 8684 tablet_bootstrap.cc:654] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:53.810254 8687 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Bootstrap starting.
I20260808 07:48:53.811959 8684 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: No bootstrap required, opened a new log
I20260808 07:48:53.812104 8686 tablet_bootstrap.cc:654] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:53.812441 8684 ts_tablet_manager.cc:1403] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260808 07:48:53.814754 8684 raft_consensus.cc:359] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.815491 8684 raft_consensus.cc:385] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:53.815843 8684 raft_consensus.cc:740] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd05455992da474c8cc9aae58037b6ee, State: Initialized, Role: FOLLOWER
I20260808 07:48:53.816591 8684 consensus_queue.cc:260] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.817472 8687 tablet_bootstrap.cc:654] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Neither blocks nor log segments found. Creating new log.
I20260808 07:48:53.817833 8686 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: No bootstrap required, opened a new log
I20260808 07:48:53.818403 8686 ts_tablet_manager.cc:1403] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260808 07:48:53.819242 8684 ts_tablet_manager.cc:1434] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 07:48:53.820047 8299 heartbeater.cc:499] Master 127.1.155.126:38509 was elected leader, sending a full tablet report...
I20260808 07:48:53.821771 8686 raft_consensus.cc:359] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.822722 8686 raft_consensus.cc:385] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:53.822989 8686 raft_consensus.cc:740] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb1aae7502b4639b7e9fbfe4884af54, State: Initialized, Role: FOLLOWER
I20260808 07:48:53.823817 8686 consensus_queue.cc:260] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.824987 8687 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: No bootstrap required, opened a new log
I20260808 07:48:53.825610 8687 ts_tablet_manager.cc:1403] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Time spent bootstrapping tablet: real 0.017s user 0.014s sys 0.000s
I20260808 07:48:53.828610 8538 heartbeater.cc:499] Master 127.1.155.126:38509 was elected leader, sending a full tablet report...
I20260808 07:48:53.829053 8686 ts_tablet_manager.cc:1434] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260808 07:48:53.830154 8687 raft_consensus.cc:359] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.830780 8687 raft_consensus.cc:385] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:48:53.831007 8687 raft_consensus.cc:740] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7264b602a0e244e0b45f52e1ad5a551d, State: Initialized, Role: FOLLOWER
I20260808 07:48:53.831792 8687 consensus_queue.cc:260] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.834470 8652 heartbeater.cc:499] Master 127.1.155.126:38509 was elected leader, sending a full tablet report...
I20260808 07:48:53.835028 8687 ts_tablet_manager.cc:1434] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 07:48:53.977286 8691 raft_consensus.cc:493] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:48:53.977826 8691 raft_consensus.cc:515] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:53.979945 8691 leader_election.cc:290] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683), 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385)
I20260808 07:48:53.991485 8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08556ea7e104267ac582029b6c23b2d" candidate_uuid: "dd05455992da474c8cc9aae58037b6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" is_pre_election: true
I20260808 07:48:53.992314 8501 raft_consensus.cc:2468] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd05455992da474c8cc9aae58037b6ee in term 0.
I20260808 07:48:53.993373 8613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08556ea7e104267ac582029b6c23b2d" candidate_uuid: "dd05455992da474c8cc9aae58037b6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7264b602a0e244e0b45f52e1ad5a551d" is_pre_election: true
I20260808 07:48:53.993464 8204 leader_election.cc:304] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cb1aae7502b4639b7e9fbfe4884af54, dd05455992da474c8cc9aae58037b6ee; no voters:
I20260808 07:48:53.993978 8613 raft_consensus.cc:2468] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd05455992da474c8cc9aae58037b6ee in term 0.
I20260808 07:48:53.994261 8691 raft_consensus.cc:2804] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:48:53.994668 8691 raft_consensus.cc:493] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:48:53.995000 8691 raft_consensus.cc:3060] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:54.000110 8691 raft_consensus.cc:515] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:54.001725 8691 leader_election.cc:290] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [CANDIDATE]: Term 1 election: Requested vote from peers 6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683), 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385)
I20260808 07:48:54.002517 8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08556ea7e104267ac582029b6c23b2d" candidate_uuid: "dd05455992da474c8cc9aae58037b6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cb1aae7502b4639b7e9fbfe4884af54"
I20260808 07:48:54.002825 8613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08556ea7e104267ac582029b6c23b2d" candidate_uuid: "dd05455992da474c8cc9aae58037b6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7264b602a0e244e0b45f52e1ad5a551d"
I20260808 07:48:54.003010 8501 raft_consensus.cc:3060] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:54.003371 8613 raft_consensus.cc:3060] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:48:54.008322 8501 raft_consensus.cc:2468] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd05455992da474c8cc9aae58037b6ee in term 1.
I20260808 07:48:54.008322 8613 raft_consensus.cc:2468] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd05455992da474c8cc9aae58037b6ee in term 1.
I20260808 07:48:54.009876 8204 leader_election.cc:304] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cb1aae7502b4639b7e9fbfe4884af54, dd05455992da474c8cc9aae58037b6ee; no voters:
I20260808 07:48:54.010599 8691 raft_consensus.cc:2804] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:48:54.011746 8691 raft_consensus.cc:697] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 LEADER]: Becoming Leader. State: Replica: dd05455992da474c8cc9aae58037b6ee, State: Running, Role: LEADER
I20260808 07:48:54.012514 8691 consensus_queue.cc:237] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } }
I20260808 07:48:54.019191 8095 catalog_manager.cc:5697] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to dd05455992da474c8cc9aae58037b6ee (127.1.155.65). New cstate: current_term: 1 leader_uuid: "dd05455992da474c8cc9aae58037b6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 } health_report { overall_health: UNKNOWN } } }
I20260808 07:48:54.347790 8363 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:54.348780 8488 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:54.350517 8597 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:54.352246 8249 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 07:48:54.475422 8420 heartbeater.cc:499] Master 127.1.155.126:38509 was elected leader, sending a full tablet report...
I20260808 07:48:54.501276 8691 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 07:48:54.511545 8691 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7264b602a0e244e0b45f52e1ad5a551d" member_type: VOTER last_known_addr { host: "127.1.155.68" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
853217b72ebd48419bf853350c5570cf | 127.1.155.126:38509 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | HEALTHY | <none> | 0 | 0
6cb1aae7502b4639b7e9fbfe4884af54 | 127.1.155.67:41683 | HEALTHY | <none> | 0 | 0
7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | HEALTHY | <none> | 0 | 0
dd05455992da474c8cc9aae58037b6ee | 127.1.155.65:33741 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f08556ea7e104267ac582029b6c23b2d of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
dd05455992da474c8cc9aae58037b6ee (127.1.155.65:33741): RUNNING [LEADER]
6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683): RUNNING
7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385): RUNNING
All reported replicas are:
A = dd05455992da474c8cc9aae58037b6ee
B = 6cb1aae7502b4639b7e9fbfe4884af54
C = 7264b602a0e244e0b45f52e1ad5a551d
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 1 | -1 | Yes
B | A B C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:54.692512 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:55.077992 8363 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.083019 8488 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.085336 8597 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.089517 8249 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
853217b72ebd48419bf853350c5570cf | 127.1.155.126:38509 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | HEALTHY | <none> | 0 | 0
6cb1aae7502b4639b7e9fbfe4884af54 | 127.1.155.67:41683 | HEALTHY | <none> | 0 | 0
7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | HEALTHY | <none> | 0 | 0
dd05455992da474c8cc9aae58037b6ee | 127.1.155.65:33741 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 07:48:55.370512 1645 log_verifier.cc:126] Checking tablet f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:55.432459 1645 log_verifier.cc:177] Verified matching terms for 1 ops in tablet f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:55.433001 1645 tablet_replica.cc:333] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: stopping tablet replica
I20260808 07:48:55.433542 1645 raft_consensus.cc:2243] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:55.434054 1645 raft_consensus.cc:2272] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:55.584357 8206 consensus_queue.cc:579] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: The tablet replica hosted on peer 7264b602a0e244e0b45f52e1ad5a551d has failed
W20260808 07:48:55.584956 8206 consensus_peers.cc:597] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee -> Peer 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385): Couldn't send request to peer 7264b602a0e244e0b45f52e1ad5a551d. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:55.594444 8267 consensus_queue.cc:237] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } }
I20260808 07:48:55.602669 8501 raft_consensus.cc:1275] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Refusing update from remote peer dd05455992da474c8cc9aae58037b6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:48:55.604434 8824 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 07:48:55.611618 8844 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } }
I20260808 07:48:55.613750 8501 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } }
I20260808 07:48:55.624580 8077 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f08556ea7e104267ac582029b6c23b2d with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260808 07:48:55.628118 8095 catalog_manager.cc:5697] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 reported cstate change: config changed from index -1 to 2, VOTER 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68) evicted. New cstate: current_term: 1 leader_uuid: "dd05455992da474c8cc9aae58037b6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } }
I20260808 07:48:55.645123 8597 tablet_service.cc:1558] Processing DeleteTablet for tablet f08556ea7e104267ac582029b6c23b2d with delete_type TABLET_DATA_TOMBSTONED (TS 7264b602a0e244e0b45f52e1ad5a551d not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:37656
I20260808 07:48:55.647876 8862 ts_tablet_manager.cc:1916] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260808 07:48:55.649565 8267 consensus_queue.cc:237] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } }
I20260808 07:48:55.658895 8501 raft_consensus.cc:1275] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Refusing update from remote peer dd05455992da474c8cc9aae58037b6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260808 07:48:55.663733 8824 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 07:48:55.672788 8824 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } } }
I20260808 07:48:55.677081 8862 ts_tablet_manager.cc:1929] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260808 07:48:55.676236 8499 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } } }
I20260808 07:48:55.682150 8862 log.cc:1199] T f08556ea7e104267ac582029b6c23b2d P 7264b602a0e244e0b45f52e1ad5a551d: Deleting WAL directory at /tmp/dist-test-taskwUZI3O/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786175273611720-1645-0/minicluster-data/ts-3-root/wals/f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:55.684414 8077 catalog_manager.cc:5028] TS 7264b602a0e244e0b45f52e1ad5a551d (127.1.155.68:39385): tablet f08556ea7e104267ac582029b6c23b2d (table test-workload [id=970ef48d9d6c4c24a9485e83ca6a30d2]) successfully deleted
W20260808 07:48:55.682200 8204 consensus_peers.cc:597] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee -> Peer 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66:32949): Couldn't send request to peer 3c6d7ffe823e4ce9a13ccb0a7012ca9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f08556ea7e104267ac582029b6c23b2d. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:48:55.700004 8077 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f08556ea7e104267ac582029b6c23b2d with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260808 07:48:55.701251 8363 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.703739 8094 catalog_manager.cc:5697] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 reported cstate change: config changed from index 2 to 3, NON_VOTER 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) added. New cstate: current_term: 1 leader_uuid: "dd05455992da474c8cc9aae58037b6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } } }
I20260808 07:48:55.748458 8488 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.758648 8597 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:55.767174 8249 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
853217b72ebd48419bf853350c5570cf | 127.1.155.126:38509 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | HEALTHY | <none> | 0 | 0
6cb1aae7502b4639b7e9fbfe4884af54 | 127.1.155.67:41683 | HEALTHY | <none> | 0 | 0
7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | HEALTHY | <none> | 0 | 0
dd05455992da474c8cc9aae58037b6ee | 127.1.155.65:33741 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f08556ea7e104267ac582029b6c23b2d of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
dd05455992da474c8cc9aae58037b6ee (127.1.155.65:33741): RUNNING [LEADER]
6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683): RUNNING
All reported replicas are:
A = dd05455992da474c8cc9aae58037b6ee
B = 6cb1aae7502b4639b7e9fbfe4884af54
C = 3c6d7ffe823e4ce9a13ccb0a7012ca9d
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B | | | Yes
A | A* B C~ | 1 | 3 | Yes
B | A* B C~ | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 2
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:55.996511 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:56.124846 8886 ts_tablet_manager.cc:933] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Initiating tablet copy from peer dd05455992da474c8cc9aae58037b6ee (127.1.155.65:33741)
I20260808 07:48:56.126614 8886 tablet_copy_client.cc:323] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: tablet copy: Beginning tablet copy session from remote peer at address 127.1.155.65:33741
I20260808 07:48:56.139917 8279 tablet_copy_service.cc:140] P dd05455992da474c8cc9aae58037b6ee: Received BeginTabletCopySession request for tablet f08556ea7e104267ac582029b6c23b2d from peer 3c6d7ffe823e4ce9a13ccb0a7012ca9d ({username='slave'} at 127.0.0.1:53184)
I20260808 07:48:56.140475 8279 tablet_copy_service.cc:161] P dd05455992da474c8cc9aae58037b6ee: Beginning new tablet copy session on tablet f08556ea7e104267ac582029b6c23b2d from peer 3c6d7ffe823e4ce9a13ccb0a7012ca9d at {username='slave'} at 127.0.0.1:53184: session id = 3c6d7ffe823e4ce9a13ccb0a7012ca9d-f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:56.148212 8279 tablet_copy_source_session.cc:215] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:48:56.152094 8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08556ea7e104267ac582029b6c23b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:48:56.168650 8886 tablet_copy_client.cc:806] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: tablet copy: Starting download of 0 data blocks...
I20260808 07:48:56.169304 8886 tablet_copy_client.cc:670] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: tablet copy: Starting download of 1 WAL segments...
I20260808 07:48:56.173677 8886 tablet_copy_client.cc:538] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:48:56.183071 8886 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Bootstrap starting.
I20260808 07:48:56.202421 8886 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:48:56.203219 8886 tablet_bootstrap.cc:492] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Bootstrap complete.
I20260808 07:48:56.203895 8886 ts_tablet_manager.cc:1403] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.004s
I20260808 07:48:56.206241 8886 raft_consensus.cc:359] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } }
I20260808 07:48:56.206818 8886 raft_consensus.cc:740] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c6d7ffe823e4ce9a13ccb0a7012ca9d, State: Initialized, Role: LEARNER
I20260808 07:48:56.207382 8886 consensus_queue.cc:260] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: NON_VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: true } }
I20260808 07:48:56.210064 8886 ts_tablet_manager.cc:1434] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 07:48:56.212170 8279 tablet_copy_service.cc:342] P dd05455992da474c8cc9aae58037b6ee: Request end of tablet copy session 3c6d7ffe823e4ce9a13ccb0a7012ca9d-f08556ea7e104267ac582029b6c23b2d received from {username='slave'} at 127.0.0.1:53184
I20260808 07:48:56.212574 8279 tablet_copy_service.cc:434] P dd05455992da474c8cc9aae58037b6ee: ending tablet copy session 3c6d7ffe823e4ce9a13ccb0a7012ca9d-f08556ea7e104267ac582029b6c23b2d on tablet f08556ea7e104267ac582029b6c23b2d with peer 3c6d7ffe823e4ce9a13ccb0a7012ca9d
I20260808 07:48:56.412510 8488 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:56.415545 8597 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:56.416589 8363 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:56.423622 8249 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 07:48:56.589499 8377 raft_consensus.cc:1217] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3] Dedup: 1.3->[]
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
853217b72ebd48419bf853350c5570cf | 127.1.155.126:38509 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | HEALTHY | <none> | 0 | 0
6cb1aae7502b4639b7e9fbfe4884af54 | 127.1.155.67:41683 | HEALTHY | <none> | 0 | 0
7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | HEALTHY | <none> | 0 | 0
dd05455992da474c8cc9aae58037b6ee | 127.1.155.65:33741 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f08556ea7e104267ac582029b6c23b2d of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
dd05455992da474c8cc9aae58037b6ee (127.1.155.65:33741): RUNNING [LEADER]
6cb1aae7502b4639b7e9fbfe4884af54 (127.1.155.67:41683): RUNNING
3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66:32949): RUNNING [NONVOTER]
All reported replicas are:
A = dd05455992da474c8cc9aae58037b6ee
B = 6cb1aae7502b4639b7e9fbfe4884af54
C = 3c6d7ffe823e4ce9a13ccb0a7012ca9d
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C~ | | | Yes
A | A* B C~ | 1 | 3 | Yes
B | A* B C~ | 1 | 3 | Yes
C | A B C~ | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 07:48:56.684873 1645 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 07:48:57.029126 8948 raft_consensus.cc:1064] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: attempting to promote NON_VOTER 3c6d7ffe823e4ce9a13ccb0a7012ca9d to VOTER
I20260808 07:48:57.031051 8948 consensus_queue.cc:237] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false } }
I20260808 07:48:57.037403 8377 raft_consensus.cc:1275] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 LEARNER]: Refusing update from remote peer dd05455992da474c8cc9aae58037b6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260808 07:48:57.037487 8499 raft_consensus.cc:1275] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Refusing update from remote peer dd05455992da474c8cc9aae58037b6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260808 07:48:57.039072 8948 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 07:48:57.040072 8949 consensus_queue.cc:1048] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 07:48:57.049163 8844 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false } } }
I20260808 07:48:57.051829 8499 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false } } }
I20260808 07:48:57.052132 8377 raft_consensus.cc:2955] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false } } }
I20260808 07:48:57.062381 8095 catalog_manager.cc:5697] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee reported cstate change: config changed from index 3 to 4, 3c6d7ffe823e4ce9a13ccb0a7012ca9d (127.1.155.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd05455992da474c8cc9aae58037b6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd05455992da474c8cc9aae58037b6ee" member_type: VOTER last_known_addr { host: "127.1.155.65" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cb1aae7502b4639b7e9fbfe4884af54" member_type: VOTER last_known_addr { host: "127.1.155.67" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6d7ffe823e4ce9a13ccb0a7012ca9d" member_type: VOTER last_known_addr { host: "127.1.155.66" port: 32949 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260808 07:48:57.182821 8488 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:57.185040 8363 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:57.186165 8597 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 07:48:57.192662 8249 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
853217b72ebd48419bf853350c5570cf | 127.1.155.126:38509 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
3c6d7ffe823e4ce9a13ccb0a7012ca9d | 127.1.155.66:32949 | HEALTHY | <none> | 0 | 0
6cb1aae7502b4639b7e9fbfe4884af54 | 127.1.155.67:41683 | HEALTHY | <none> | 0 | 0
7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | HEALTHY | <none> | 0 | 0
dd05455992da474c8cc9aae58037b6ee | 127.1.155.65:33741 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 7264b602a0e244e0b45f52e1ad5a551d | 127.1.155.68:39385 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 07:48:57.435333 1645 log_verifier.cc:126] Checking tablet f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:57.498061 1645 log_verifier.cc:177] Verified matching terms for 4 ops in tablet f08556ea7e104267ac582029b6c23b2d
I20260808 07:48:57.501705 1645 tablet_server.cc:179] TabletServer@127.1.155.65:0 shutting down...
I20260808 07:48:57.528584 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:57.529305 1645 tablet_replica.cc:333] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee: stopping tablet replica
I20260808 07:48:57.529855 1645 raft_consensus.cc:2243] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:57.530656 1645 raft_consensus.cc:2272] T f08556ea7e104267ac582029b6c23b2d P dd05455992da474c8cc9aae58037b6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:57.542408 1645 tablet_server.cc:196] TabletServer@127.1.155.65:0 shutdown complete.
I20260808 07:48:57.554553 1645 tablet_server.cc:179] TabletServer@127.1.155.66:0 shutting down...
I20260808 07:48:57.577766 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:57.578557 1645 tablet_replica.cc:333] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d: stopping tablet replica
I20260808 07:48:57.579098 1645 raft_consensus.cc:2243] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:57.579603 1645 raft_consensus.cc:2272] T f08556ea7e104267ac582029b6c23b2d P 3c6d7ffe823e4ce9a13ccb0a7012ca9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:57.599653 1645 tablet_server.cc:196] TabletServer@127.1.155.66:0 shutdown complete.
I20260808 07:48:57.611152 1645 tablet_server.cc:179] TabletServer@127.1.155.67:0 shutting down...
I20260808 07:48:57.633621 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:57.634377 1645 tablet_replica.cc:333] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54: stopping tablet replica
I20260808 07:48:57.634902 1645 raft_consensus.cc:2243] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:48:57.635437 1645 raft_consensus.cc:2272] T f08556ea7e104267ac582029b6c23b2d P 6cb1aae7502b4639b7e9fbfe4884af54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:57.656785 1645 tablet_server.cc:196] TabletServer@127.1.155.67:0 shutdown complete.
I20260808 07:48:57.668421 1645 tablet_server.cc:179] TabletServer@127.1.155.68:0 shutting down...
I20260808 07:48:57.688625 1645 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 07:48:57.706674 1645 tablet_server.cc:196] TabletServer@127.1.155.68:0 shutdown complete.
I20260808 07:48:57.719123 1645 master.cc:562] Master@127.1.155.126:38509 shutting down...
I20260808 07:48:57.739096 1645 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:48:57.739739 1645 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:48:57.740078 1645 tablet_replica.cc:333] T 00000000000000000000000000000000 P 853217b72ebd48419bf853350c5570cf: stopping tablet replica
I20260808 07:48:57.759611 1645 master.cc:584] Master@127.1.155.126:38509 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4728 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (9080 ms total)
[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (63899 ms total)
[ PASSED ] 11 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[ FAILED ] 1 test, listed below:
[ FAILED ] TsTabletManagerITest.TestTableStats
1 FAILED TEST
I20260808 07:48:57.798440 1645 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~9 seconds ago
I20260808 07:48:57.798765 1645 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 15 messages since previous log ~14 seconds ago
I20260808 07:48:57.798961 1645 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 53 messages since previous log ~54 seconds ago
I20260808 07:48:57.799154 1645 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 7 messages since previous log ~13 seconds ago