[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 16:57:45.254091 10837 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.328s user 0.490s sys 0.838s
W20260811 16:57:45.254715 10837 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.329s user 0.490s sys 0.838s
I20260811 16:57:45.260176 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:39021
I20260811 16:57:45.262275 10837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:57:45.263703 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:45.282706 10856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:45.282708 10855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:45.446692 10858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:45.446945 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:45.449331 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:45.449796 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:45.450070 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467465450044 us; error 0 us; skew 500 ppm
I20260811 16:57:45.451031 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:45.458292 10837 webserver.cc:460] Webserver started at http://127.10.149.126:36313/ using document root <none> and password file <none>
I20260811 16:57:45.459594 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:45.459841 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:45.460402 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:45.467844 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "11bbcd7aa8304f43bda8deab23016190"
format_stamp: "Formatted at 2026-08-11 16:57:45 on dist-test-slave-j2vl"
I20260811 16:57:45.478571 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.009s sys 0.002s
I20260811 16:57:45.485445 10864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:45.487051 10837 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260811 16:57:45.487452 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "11bbcd7aa8304f43bda8deab23016190"
format_stamp: "Formatted at 2026-08-11 16:57:45 on dist-test-slave-j2vl"
I20260811 16:57:45.487888 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:45.535199 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:45.537523 10837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:57:45.538064 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:45.644847 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:39021
I20260811 16:57:45.645187 10952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:39021 every 8 connection(s)
I20260811 16:57:45.652418 10953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:45.691188 10953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: Bootstrap starting.
I20260811 16:57:45.697857 10953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:45.700260 10953 log.cc:824] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: Log is configured to *not* fsync() on all Append() calls
I20260811 16:57:45.706923 10953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: No bootstrap required, opened a new log
I20260811 16:57:45.733564 10953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER }
I20260811 16:57:45.734472 10953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:45.734854 10953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bbcd7aa8304f43bda8deab23016190, State: Initialized, Role: FOLLOWER
I20260811 16:57:45.736210 10953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER }
I20260811 16:57:45.736953 10953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:57:45.737247 10953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:57:45.737694 10953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:45.743855 10953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER }
I20260811 16:57:45.744793 10953 leader_election.cc:302] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11bbcd7aa8304f43bda8deab23016190; no voters:
I20260811 16:57:45.746820 10953 leader_election.cc:288] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:57:45.747321 10960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:45.750174 10960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 1 LEADER]: Becoming Leader. State: Replica: 11bbcd7aa8304f43bda8deab23016190, State: Running, Role: LEADER
I20260811 16:57:45.751159 10960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER }
I20260811 16:57:45.751854 10953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:57:45.762413 10962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11bbcd7aa8304f43bda8deab23016190. Latest consensus state: current_term: 1 leader_uuid: "11bbcd7aa8304f43bda8deab23016190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER } }
I20260811 16:57:45.762548 10961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11bbcd7aa8304f43bda8deab23016190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11bbcd7aa8304f43bda8deab23016190" member_type: VOTER } }
I20260811 16:57:45.763743 10962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:45.763774 10961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:45.775029 10972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:57:45.791031 10972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:57:45.793556 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:57:45.815944 10972 catalog_manager.cc:1347] Generated new cluster ID: 98af34393a1a4dd8b73b8dba87f32c65
I20260811 16:57:45.816473 10972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:57:45.848755 10972 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:57:45.851907 10972 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:57:45.874673 10972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: Generated new TSK 0
I20260811 16:57:45.876072 10972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:57:45.929740 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:45.940979 10999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:45.945757 11002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:45.949316 11005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:45.950074 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:45.951256 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:45.951565 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:45.951781 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467465951769 us; error 0 us; skew 500 ppm
I20260811 16:57:45.952824 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:45.958079 10837 webserver.cc:460] Webserver started at http://127.10.149.65:35877/ using document root <none> and password file <none>
I20260811 16:57:45.958684 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:45.958910 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:45.959259 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:45.960770 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7"
format_stamp: "Formatted at 2026-08-11 16:57:45 on dist-test-slave-j2vl"
I20260811 16:57:45.967461 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260811 16:57:45.972333 11013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:45.973295 10837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 16:57:45.973671 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7"
format_stamp: "Formatted at 2026-08-11 16:57:45 on dist-test-slave-j2vl"
I20260811 16:57:45.974030 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:45.997845 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:46.000631 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:46.004096 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:46.009558 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:46.009894 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:46.010247 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:46.010440 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:46.136647 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:33275
I20260811 16:57:46.136740 11124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:33275 every 8 connection(s)
I20260811 16:57:46.145521 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:46.165274 11131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:46.175356 11132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:46.177706 11140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:46.178063 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:46.179293 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:46.179606 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:46.179865 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467466179837 us; error 0 us; skew 500 ppm
I20260811 16:57:46.180884 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:46.192592 10837 webserver.cc:460] Webserver started at http://127.10.149.66:37875/ using document root <none> and password file <none>
I20260811 16:57:46.198253 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:46.198623 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:46.198983 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:46.200563 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "26b6084432994368aa2ee3e69d67aed3"
format_stamp: "Formatted at 2026-08-11 16:57:46 on dist-test-slave-j2vl"
I20260811 16:57:46.205222 11125 heartbeater.cc:347] Connected to a master server at 127.10.149.126:39021
I20260811 16:57:46.205811 11125 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:46.207170 11125 heartbeater.cc:511] Master 127.10.149.126:39021 requested a full tablet report, sending...
I20260811 16:57:46.208336 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 16:57:46.211333 10893 ts_manager.cc:194] Registered new tserver with Master: 2f4a782ccb5c4229a5bcb3e2de86b1e7 (127.10.149.65:33275)
I20260811 16:57:46.213958 10893 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33052
I20260811 16:57:46.216178 11146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:46.217584 10837 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260811 16:57:46.218118 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "26b6084432994368aa2ee3e69d67aed3"
format_stamp: "Formatted at 2026-08-11 16:57:46 on dist-test-slave-j2vl"
I20260811 16:57:46.218470 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:46.264983 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:46.266467 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:46.268245 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:46.271698 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:46.271951 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:46.272203 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:46.272365 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:46.319523 11125 heartbeater.cc:503] Master 127.10.149.126:39021 was elected leader, sending a full tablet report...
I20260811 16:57:46.388339 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:41737
I20260811 16:57:46.388532 11262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:41737 every 8 connection(s)
I20260811 16:57:46.411865 11263 heartbeater.cc:347] Connected to a master server at 127.10.149.126:39021
I20260811 16:57:46.412305 11263 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:46.413142 11263 heartbeater.cc:511] Master 127.10.149.126:39021 requested a full tablet report, sending...
I20260811 16:57:46.416275 10893 ts_manager.cc:194] Registered new tserver with Master: 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66:41737)
I20260811 16:57:46.416386 10837 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.020288376s
I20260811 16:57:46.419229 10893 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33066
I20260811 16:57:46.456555 10893 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:57:46.484922 10893 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260811 16:57:46.523046 11263 heartbeater.cc:503] Master 127.10.149.126:39021 was elected leader, sending a full tablet report...
W20260811 16:57:46.571156 10963 log.cc:924] Time spent T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: Append to log took a long time: real 0.077s user 0.000s sys 0.002s
I20260811 16:57:46.639071 11060 tablet_service.cc:1467] Processing CreateTablet for tablet 947ea97e1e334a72b91a425bd9ce078a (DEFAULT_TABLE table=test-table [id=d45e8d5e5a77422b9cefc334146d8f94]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:46.639473 11059 tablet_service.cc:1467] Processing CreateTablet for tablet 7426dced0a814e009c53c4af963fda9a (DEFAULT_TABLE table=test-table [id=d45e8d5e5a77422b9cefc334146d8f94]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:46.640729 11060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947ea97e1e334a72b91a425bd9ce078a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:46.641414 11059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7426dced0a814e009c53c4af963fda9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:46.649106 11204 tablet_service.cc:1467] Processing CreateTablet for tablet 947ea97e1e334a72b91a425bd9ce078a (DEFAULT_TABLE table=test-table [id=d45e8d5e5a77422b9cefc334146d8f94]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:46.649688 11201 tablet_service.cc:1467] Processing CreateTablet for tablet 7426dced0a814e009c53c4af963fda9a (DEFAULT_TABLE table=test-table [id=d45e8d5e5a77422b9cefc334146d8f94]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:46.650923 11204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947ea97e1e334a72b91a425bd9ce078a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:46.653865 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7426dced0a814e009c53c4af963fda9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:46.674831 11289 tablet_bootstrap.cc:492] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Bootstrap starting.
I20260811 16:57:46.678851 11291 tablet_bootstrap.cc:492] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: Bootstrap starting.
I20260811 16:57:46.682344 11289 tablet_bootstrap.cc:654] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:46.686630 11291 tablet_bootstrap.cc:654] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:46.689018 11289 tablet_bootstrap.cc:492] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: No bootstrap required, opened a new log
I20260811 16:57:46.689672 11289 ts_tablet_manager.cc:1397] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.006s
I20260811 16:57:46.693089 11289 raft_consensus.cc:348] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:46.694197 11289 raft_consensus.cc:729] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f4a782ccb5c4229a5bcb3e2de86b1e7, State: Initialized, Role: FOLLOWER
I20260811 16:57:46.694789 11289 consensus_queue.cc:260] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:46.697322 11291 tablet_bootstrap.cc:492] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: No bootstrap required, opened a new log
I20260811 16:57:46.697976 11291 ts_tablet_manager.cc:1397] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.005s
I20260811 16:57:46.699295 11289 ts_tablet_manager.cc:1428] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260811 16:57:46.700335 11289 tablet_bootstrap.cc:492] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Bootstrap starting.
I20260811 16:57:46.700837 11291 raft_consensus.cc:348] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:46.701877 11291 raft_consensus.cc:729] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Initialized, Role: FOLLOWER
I20260811 16:57:46.702508 11291 consensus_queue.cc:260] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:46.710028 11289 tablet_bootstrap.cc:654] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:46.712594 11291 ts_tablet_manager.cc:1428] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260811 16:57:46.713518 11291 tablet_bootstrap.cc:492] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: Bootstrap starting.
I20260811 16:57:46.720181 11291 tablet_bootstrap.cc:654] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:46.754315 11291 tablet_bootstrap.cc:492] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: No bootstrap required, opened a new log
I20260811 16:57:46.754805 11291 ts_tablet_manager.cc:1397] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.013s
I20260811 16:57:46.755550 11289 tablet_bootstrap.cc:492] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: No bootstrap required, opened a new log
I20260811 16:57:46.756034 11289 ts_tablet_manager.cc:1397] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Time spent bootstrapping tablet: real 0.056s user 0.024s sys 0.010s
I20260811 16:57:46.758734 11289 raft_consensus.cc:348] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:46.759451 11289 raft_consensus.cc:729] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f4a782ccb5c4229a5bcb3e2de86b1e7, State: Initialized, Role: FOLLOWER
I20260811 16:57:46.759400 11291 raft_consensus.cc:348] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:46.760164 11291 raft_consensus.cc:729] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Initialized, Role: FOLLOWER
I20260811 16:57:46.760175 11289 consensus_queue.cc:260] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:46.760835 11291 consensus_queue.cc:260] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:46.762493 11289 ts_tablet_manager.cc:1428] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Time spent starting tablet: real 0.006s user 0.003s sys 0.005s
I20260811 16:57:46.764875 11291 ts_tablet_manager.cc:1428] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: Time spent starting tablet: real 0.010s user 0.000s sys 0.006s
I20260811 16:57:46.783412 10837 ts_tablet_manager-itest.cc:367] Electing peer 2...
I20260811 16:57:46.783715 10837 raft_consensus.cc:412] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Emulating election...
I20260811 16:57:46.783937 10837 raft_consensus.cc:3037] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:46.788116 10837 raft_consensus.cc:686] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Becoming Leader. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:46.788892 10837 consensus_queue.cc:237] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:46.793529 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:46.801791 10892 catalog_manager.cc:5495] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66). New cstate: current_term: 1 leader_uuid: "26b6084432994368aa2ee3e69d67aed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: UNKNOWN } } }
I20260811 16:57:46.831408 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
W20260811 16:57:46.895334 11128 tablet.cc:2369] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:57:46.937551 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260811 16:57:47.142652 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260811 16:57:47.356417 11077 raft_consensus.cc:3037] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:47.365861 11315 consensus_queue.cc:1035] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:57:47.447602 10837 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260811 16:57:47.447925 10837 raft_consensus.cc:412] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Emulating election...
I20260811 16:57:47.448192 10837 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:47.454339 10837 raft_consensus.cc:686] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Becoming Leader. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:47.455179 10837 consensus_queue.cc:237] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:47.457950 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:47.462625 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260811 16:57:47.463253 10892 catalog_manager.cc:5495] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66). New cstate: current_term: 1 leader_uuid: "26b6084432994368aa2ee3e69d67aed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: HEALTHY } } }
I20260811 16:57:47.567616 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260811 16:57:47.772624 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260811 16:57:47.861917 11077 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:47.868490 11321 consensus_queue.cc:1035] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:57:48.278203 10837 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260811 16:57:48.278492 10837 raft_consensus.cc:412] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Emulating election...
I20260811 16:57:48.278697 10837 raft_consensus.cc:3032] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:57:48.278867 10837 raft_consensus.cc:729] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:48.279333 10837 consensus_queue.cc:260] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:48.280117 10837 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:48.285439 10837 raft_consensus.cc:686] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 2 LEADER]: Becoming Leader. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:48.286023 10837 consensus_queue.cc:237] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:48.287417 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:48.292568 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260811 16:57:48.292222 10890 catalog_manager.cc:5495] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "26b6084432994368aa2ee3e69d67aed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: HEALTHY } } }
I20260811 16:57:48.397418 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260811 16:57:48.601980 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260811 16:57:48.856315 11077 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:48.861259 11077 raft_consensus.cc:1261] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 FOLLOWER]: Refusing update from remote peer 26b6084432994368aa2ee3e69d67aed3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:57:48.862867 11321 consensus_queue.cc:1035] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:57:48.906905 10837 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260811 16:57:48.907215 10837 raft_consensus.cc:412] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 FOLLOWER]: Emulating election...
I20260811 16:57:48.907505 10837 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:57:48.912618 10837 raft_consensus.cc:686] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f4a782ccb5c4229a5bcb3e2de86b1e7, State: Running, Role: LEADER
I20260811 16:57:48.913303 10837 consensus_queue.cc:237] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:48.914997 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:48.918939 10892 catalog_manager.cc:5495] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 reported cstate change: term changed from 2 to 3, leader changed from 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66) to 2f4a782ccb5c4229a5bcb3e2de86b1e7 (127.10.149.65). New cstate: current_term: 3 leader_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: UNKNOWN } } }
I20260811 16:57:48.919425 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260811 16:57:49.023993 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260811 16:57:49.228150 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260811 16:57:49.493667 11077 raft_consensus.cc:1226] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 3 LEADER]: Rejecting Update request from peer 26b6084432994368aa2ee3e69d67aed3 for earlier term 2. Current term is 3. Ops: []
I20260811 16:57:49.495160 11340 consensus_queue.cc:1046] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:57:49.496357 11340 consensus_queue.cc:1225] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Peer 2f4a782ccb5c4229a5bcb3e2de86b1e7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260811 16:57:49.499212 11220 raft_consensus.cc:3032] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:57:49.499469 11220 raft_consensus.cc:729] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:49.500092 11220 consensus_queue.cc:260] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:49.501048 11220 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:57:49.506096 11220 raft_consensus.cc:1261] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 3 FOLLOWER]: Refusing update from remote peer 2f4a782ccb5c4229a5bcb3e2de86b1e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260811 16:57:49.506650 11359 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260811 16:57:49.507669 11351 consensus_queue.cc:1035] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:57:49.732681 10837 ts_tablet_manager-itest.cc:367] Electing peer 1...
I20260811 16:57:49.733002 10837 raft_consensus.cc:412] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 1 FOLLOWER]: Emulating election...
I20260811 16:57:49.733238 10837 raft_consensus.cc:3037] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:49.738649 10837 raft_consensus.cc:686] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f4a782ccb5c4229a5bcb3e2de86b1e7, State: Running, Role: LEADER
I20260811 16:57:49.739301 10837 consensus_queue.cc:237] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:49.741425 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:49.745443 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260811 16:57:49.745105 10890 catalog_manager.cc:5495] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 reported cstate change: term changed from 1 to 2, leader changed from 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66) to 2f4a782ccb5c4229a5bcb3e2de86b1e7 (127.10.149.65). New cstate: current_term: 2 leader_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: HEALTHY } } }
I20260811 16:57:49.850502 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260811 16:57:50.055119 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260811 16:57:50.068660 11077 raft_consensus.cc:1226] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 LEADER]: Rejecting Update request from peer 26b6084432994368aa2ee3e69d67aed3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:57:50.069916 11359 consensus_queue.cc:1046] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:57:50.071074 11359 consensus_queue.cc:1225] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Peer 2f4a782ccb5c4229a5bcb3e2de86b1e7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260811 16:57:50.071480 11371 raft_consensus.cc:3032] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:57:50.071748 11371 raft_consensus.cc:729] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:50.072309 11371 consensus_queue.cc:260] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } } peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } }
I20260811 16:57:50.073076 11371 raft_consensus.cc:3037] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:50.131601 11220 raft_consensus.cc:1261] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 2 FOLLOWER]: Refusing update from remote peer 2f4a782ccb5c4229a5bcb3e2de86b1e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:57:50.133064 11360 consensus_queue.cc:1035] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:57:50.360761 10837 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260811 16:57:50.361109 10837 raft_consensus.cc:412] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 3 FOLLOWER]: Emulating election...
I20260811 16:57:50.361461 10837 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:57:50.366536 10837 raft_consensus.cc:686] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 4 LEADER]: Becoming Leader. State: Replica: 26b6084432994368aa2ee3e69d67aed3, State: Running, Role: LEADER
I20260811 16:57:50.367336 10837 consensus_queue.cc:237] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:50.369120 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:50.372835 10890 catalog_manager.cc:5495] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 reported cstate change: term changed from 3 to 4, leader changed from 2f4a782ccb5c4229a5bcb3e2de86b1e7 (127.10.149.65) to 26b6084432994368aa2ee3e69d67aed3 (127.10.149.66). New cstate: current_term: 4 leader_uuid: "26b6084432994368aa2ee3e69d67aed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } health_report { overall_health: HEALTHY } } }
I20260811 16:57:50.374347 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260811 16:57:50.478799 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260811 16:57:50.632715 11220 raft_consensus.cc:1226] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 4 LEADER]: Rejecting Update request from peer 2f4a782ccb5c4229a5bcb3e2de86b1e7 for earlier term 3. Current term is 4. Ops: []
I20260811 16:57:50.633996 11360 consensus_queue.cc:1046] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:57:50.634627 11360 consensus_queue.cc:1225] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [LEADER]: Peer 26b6084432994368aa2ee3e69d67aed3 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:57:50.635017 11373 raft_consensus.cc:3032] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:57:50.635258 11373 raft_consensus.cc:729] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f4a782ccb5c4229a5bcb3e2de86b1e7, State: Running, Role: LEADER
I20260811 16:57:50.635728 11373 consensus_queue.cc:260] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 } } peers { permanent_uuid: "26b6084432994368aa2ee3e69d67aed3" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 41737 } }
I20260811 16:57:50.636417 11373 raft_consensus.cc:3037] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:57:50.683143 10837 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260811 16:57:50.796492 11077 raft_consensus.cc:1261] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 4 FOLLOWER]: Refusing update from remote peer 26b6084432994368aa2ee3e69d67aed3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:57:50.797986 11371 consensus_queue.cc:1035] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f4a782ccb5c4229a5bcb3e2de86b1e7" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:57:51.189556 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:57:51.221029 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:51.222187 10837 tablet_replica.cc:330] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: stopping tablet replica
I20260811 16:57:51.222906 10837 raft_consensus.cc:2229] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:57:51.223588 10837 raft_consensus.cc:2258] T 7426dced0a814e009c53c4af963fda9a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:51.226480 10837 tablet_replica.cc:330] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7: stopping tablet replica
I20260811 16:57:51.227085 10837 raft_consensus.cc:2229] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:57:51.227695 10837 raft_consensus.cc:2258] T 947ea97e1e334a72b91a425bd9ce078a P 2f4a782ccb5c4229a5bcb3e2de86b1e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:51.335081 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:57:51.346371 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
W20260811 16:57:51.364423 11148 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.149.65:33275: connect: Connection refused (error 111)
W20260811 16:57:51.370532 11148 consensus_peers.cc:487] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 -> Peer 2f4a782ccb5c4229a5bcb3e2de86b1e7 (127.10.149.65:33275): Couldn't send request to peer 2f4a782ccb5c4229a5bcb3e2de86b1e7. Status: Network error: Client connection negotiation failed: client connection to 127.10.149.65:33275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:57:51.370728 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:51.371521 10837 tablet_replica.cc:330] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3: stopping tablet replica
I20260811 16:57:51.372239 10837 raft_consensus.cc:2229] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:57:51.372794 10837 raft_consensus.cc:2258] T 947ea97e1e334a72b91a425bd9ce078a P 26b6084432994368aa2ee3e69d67aed3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:51.374509 10837 tablet_replica.cc:330] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3: stopping tablet replica
I20260811 16:57:51.374997 10837 raft_consensus.cc:2229] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 4 LEADER]: Raft consensus shutting down.
I20260811 16:57:51.375954 10837 raft_consensus.cc:2258] T 7426dced0a814e009c53c4af963fda9a P 26b6084432994368aa2ee3e69d67aed3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:51.396690 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:57:51.406704 10837 master.cc:537] Master@127.10.149.126:39021 shutting down...
I20260811 16:57:51.605397 10997 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260811 16:57:51.651625 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:51.652244 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:51.652526 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 11bbcd7aa8304f43bda8deab23016190: stopping tablet replica
I20260811 16:57:51.672641 10837 master.cc:552] Master@127.10.149.126:39021 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (7821 ms)
[ RUN ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260811 16:57:51.701535 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:41705
I20260811 16:57:51.702524 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:51.708436 11412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:51.709313 11414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:51.709896 11417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:51.712055 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:51.712792 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:51.712960 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:51.713060 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467471713053 us; error 0 us; skew 500 ppm
I20260811 16:57:51.713568 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:51.720633 10837 webserver.cc:460] Webserver started at http://127.10.149.126:33499/ using document root <none> and password file <none>
I20260811 16:57:51.721167 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:51.721326 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:51.721657 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:51.722702 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "ead3e9715fe4456899c5f3f14d82f1e3"
format_stamp: "Formatted at 2026-08-11 16:57:51 on dist-test-slave-j2vl"
I20260811 16:57:51.727150 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 16:57:51.730459 11432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:51.731302 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260811 16:57:51.731604 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "ead3e9715fe4456899c5f3f14d82f1e3"
format_stamp: "Formatted at 2026-08-11 16:57:51 on dist-test-slave-j2vl"
I20260811 16:57:51.731906 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:51.764810 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:51.766079 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:51.804694 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:41705
I20260811 16:57:51.804812 11530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:41705 every 8 connection(s)
I20260811 16:57:51.808820 11531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:51.818295 11531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3: Bootstrap starting.
I20260811 16:57:51.822477 11531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:51.827046 11531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3: No bootstrap required, opened a new log
I20260811 16:57:51.828887 11531 raft_consensus.cc:348] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER }
I20260811 16:57:51.829267 11531 raft_consensus.cc:374] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:51.829546 11531 raft_consensus.cc:729] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead3e9715fe4456899c5f3f14d82f1e3, State: Initialized, Role: FOLLOWER
I20260811 16:57:51.830125 11531 consensus_queue.cc:260] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER }
I20260811 16:57:51.830570 11531 raft_consensus.cc:388] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:57:51.830816 11531 raft_consensus.cc:482] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:57:51.831084 11531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:51.835654 11531 raft_consensus.cc:504] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER }
I20260811 16:57:51.836483 11531 leader_election.cc:302] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ead3e9715fe4456899c5f3f14d82f1e3; no voters:
I20260811 16:57:51.837797 11531 leader_election.cc:288] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:57:51.838131 11534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:51.839872 11534 raft_consensus.cc:686] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 1 LEADER]: Becoming Leader. State: Replica: ead3e9715fe4456899c5f3f14d82f1e3, State: Running, Role: LEADER
I20260811 16:57:51.840552 11534 consensus_queue.cc:237] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER }
I20260811 16:57:51.840837 11531 sys_catalog.cc:564] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:57:51.843642 11537 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ead3e9715fe4456899c5f3f14d82f1e3. Latest consensus state: current_term: 1 leader_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER } }
I20260811 16:57:51.843758 11536 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead3e9715fe4456899c5f3f14d82f1e3" member_type: VOTER } }
I20260811 16:57:51.844390 11537 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:51.844539 11536 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:51.847474 11545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:57:51.852588 11545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:57:51.857398 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:57:51.862905 11545 catalog_manager.cc:1347] Generated new cluster ID: 1c664e9d9f7c4de093ab1c3ddf8e8ccb
I20260811 16:57:51.863305 11545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:57:51.891253 11545 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:57:51.892923 11545 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:57:51.908818 11545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3: Generated new TSK 0
I20260811 16:57:51.909611 11545 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:57:51.924141 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:51.930411 11566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:51.931233 11567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:51.933892 11573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:51.934587 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:51.935617 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:51.935813 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:51.935928 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467471935920 us; error 0 us; skew 500 ppm
I20260811 16:57:51.936424 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:51.939419 10837 webserver.cc:460] Webserver started at http://127.10.149.65:45867/ using document root <none> and password file <none>
I20260811 16:57:51.939900 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:51.940073 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:51.940289 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:51.941447 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "fdae8b777d95475c904527bd0ea8981a"
format_stamp: "Formatted at 2026-08-11 16:57:51 on dist-test-slave-j2vl"
I20260811 16:57:51.946308 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 16:57:51.949908 11580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:51.951102 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 16:57:51.951499 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "fdae8b777d95475c904527bd0ea8981a"
format_stamp: "Formatted at 2026-08-11 16:57:51 on dist-test-slave-j2vl"
I20260811 16:57:51.951798 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:51.964793 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:51.966156 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:51.967631 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:51.970032 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:51.970268 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:51.970520 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:51.970681 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.011348 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:38389
I20260811 16:57:52.011477 11684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:38389 every 8 connection(s)
I20260811 16:57:52.016548 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:52.024113 11691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:52.024765 11693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.027275 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:52.028105 11698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.028975 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:52.029287 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:52.029547 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467472029531 us; error 0 us; skew 500 ppm
I20260811 16:57:52.030275 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:52.031205 11685 heartbeater.cc:347] Connected to a master server at 127.10.149.126:41705
I20260811 16:57:52.031611 11685 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:52.032548 11685 heartbeater.cc:511] Master 127.10.149.126:41705 requested a full tablet report, sending...
I20260811 16:57:52.033811 10837 webserver.cc:460] Webserver started at http://127.10.149.66:44129/ using document root <none> and password file <none>
I20260811 16:57:52.034468 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:52.034708 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:52.035005 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:52.035662 11466 ts_manager.cc:194] Registered new tserver with Master: fdae8b777d95475c904527bd0ea8981a (127.10.149.65:38389)
I20260811 16:57:52.036257 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "3d610c6c10034f6a829224820f0e05d2"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.038120 11466 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37758
I20260811 16:57:52.041884 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260811 16:57:52.045607 11703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.046439 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 16:57:52.046757 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "3d610c6c10034f6a829224820f0e05d2"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.047088 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:52.063539 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:52.064704 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:52.066478 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:52.069519 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:52.069772 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.070029 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:52.070194 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.111562 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:36801
I20260811 16:57:52.111711 11819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:36801 every 8 connection(s)
I20260811 16:57:52.126992 11820 heartbeater.cc:347] Connected to a master server at 127.10.149.126:41705
I20260811 16:57:52.127396 11820 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:52.128114 11820 heartbeater.cc:511] Master 127.10.149.126:41705 requested a full tablet report, sending...
I20260811 16:57:52.130028 11466 ts_manager.cc:194] Registered new tserver with Master: 3d610c6c10034f6a829224820f0e05d2 (127.10.149.66:36801)
I20260811 16:57:52.130479 10837 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.015650192s
I20260811 16:57:52.131753 11466 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37766
I20260811 16:57:52.141855 11685 heartbeater.cc:503] Master 127.10.149.126:41705 was elected leader, sending a full tablet report...
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:421: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260811 16:57:52.159518 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:57:52.176463 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:52.194639 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:57:52.202397 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:57:52.218935 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:52.235390 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:57:52.242535 10837 master.cc:537] Master@127.10.149.126:41705 shutting down...
I20260811 16:57:52.259230 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:52.259795 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:52.260249 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P ead3e9715fe4456899c5f3f14d82f1e3: stopping tablet replica
I20260811 16:57:52.280121 10837 master.cc:552] Master@127.10.149.126:41705 shutdown complete.
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (600 ms)
[ RUN ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260811 16:57:52.302964 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:43789
I20260811 16:57:52.304042 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:52.309018 11846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:52.310395 11847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.318385 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:52.318390 11851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.319473 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:52.319639 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:52.319748 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467472319740 us; error 0 us; skew 500 ppm
I20260811 16:57:52.320238 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:52.322659 10837 webserver.cc:460] Webserver started at http://127.10.149.126:34745/ using document root <none> and password file <none>
I20260811 16:57:52.323076 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:52.323222 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:52.323429 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:52.324460 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "1d57e0fa0af2439fac13ad59d176812e"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.328891 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 16:57:52.332087 11860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.332892 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:57:52.333120 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "1d57e0fa0af2439fac13ad59d176812e"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.333451 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:52.350126 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:52.351135 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:52.392093 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:43789
I20260811 16:57:52.392196 11964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:43789 every 8 connection(s)
I20260811 16:57:52.396536 11968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:52.406415 11968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e: Bootstrap starting.
I20260811 16:57:52.410596 11968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:52.414592 11968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e: No bootstrap required, opened a new log
I20260811 16:57:52.416395 11968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER }
I20260811 16:57:52.416776 11968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:52.417084 11968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d57e0fa0af2439fac13ad59d176812e, State: Initialized, Role: FOLLOWER
I20260811 16:57:52.417752 11968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER }
I20260811 16:57:52.418176 11968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:57:52.418368 11968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:57:52.418582 11968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:52.422706 11968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER }
I20260811 16:57:52.423238 11968 leader_election.cc:302] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d57e0fa0af2439fac13ad59d176812e; no voters:
I20260811 16:57:52.424320 11968 leader_election.cc:288] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:57:52.424693 11972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:52.426175 11972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 1 LEADER]: Becoming Leader. State: Replica: 1d57e0fa0af2439fac13ad59d176812e, State: Running, Role: LEADER
I20260811 16:57:52.426939 11972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER }
I20260811 16:57:52.427416 11968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:57:52.429960 11973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d57e0fa0af2439fac13ad59d176812e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER } }
I20260811 16:57:52.430007 11979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d57e0fa0af2439fac13ad59d176812e. Latest consensus state: current_term: 1 leader_uuid: "1d57e0fa0af2439fac13ad59d176812e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d57e0fa0af2439fac13ad59d176812e" member_type: VOTER } }
I20260811 16:57:52.430632 11973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:52.430794 11979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:52.435009 11987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:57:52.442924 11987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:57:52.445878 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:57:52.452718 11987 catalog_manager.cc:1347] Generated new cluster ID: f01dfe1f14f44c9bae8b17c429e725e5
I20260811 16:57:52.453094 11987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:57:52.488344 11987 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:57:52.490402 11987 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:57:52.504910 11987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e: Generated new TSK 0
I20260811 16:57:52.505573 11987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:57:52.512326 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:52.518893 12012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:52.520059 12014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:52.521605 12017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.522250 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:52.522971 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:52.523140 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:52.523252 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467472523244 us; error 0 us; skew 500 ppm
I20260811 16:57:52.523677 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:52.526436 10837 webserver.cc:460] Webserver started at http://127.10.149.65:44835/ using document root <none> and password file <none>
I20260811 16:57:52.526876 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:52.527025 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:52.527385 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:52.528759 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "c2b3ba002678475e8c015d6f5f90c628"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.534109 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260811 16:57:52.537784 12024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.539278 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 16:57:52.539645 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "c2b3ba002678475e8c015d6f5f90c628"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.539927 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:52.551399 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:52.552654 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:52.554625 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:52.558656 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:52.558945 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.559217 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:52.559391 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.601100 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:39841
I20260811 16:57:52.601202 12131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:39841 every 8 connection(s)
I20260811 16:57:52.605911 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:52.612715 12141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:52.615775 12143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.620200 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:52.620504 12149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:52.621567 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:52.621845 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:52.622051 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467472622034 us; error 0 us; skew 500 ppm
I20260811 16:57:52.622607 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:52.623646 12133 heartbeater.cc:347] Connected to a master server at 127.10.149.126:43789
I20260811 16:57:52.624104 12133 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:52.625138 12133 heartbeater.cc:511] Master 127.10.149.126:43789 requested a full tablet report, sending...
I20260811 16:57:52.626257 10837 webserver.cc:460] Webserver started at http://127.10.149.66:41981/ using document root <none> and password file <none>
I20260811 16:57:52.626972 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:52.627249 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:52.627887 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:52.627959 11897 ts_manager.cc:194] Registered new tserver with Master: c2b3ba002678475e8c015d6f5f90c628 (127.10.149.65:39841)
I20260811 16:57:52.630009 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "ac07452928314e8a81ff23bf78af6c13"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.630065 11897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53424
I20260811 16:57:52.636525 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 16:57:52.640811 12157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.641760 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:57:52.642165 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "ac07452928314e8a81ff23bf78af6c13"
format_stamp: "Formatted at 2026-08-11 16:57:52 on dist-test-slave-j2vl"
I20260811 16:57:52.642496 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:52.667070 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:52.668551 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:52.670536 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:52.673141 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:52.673442 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 16:57:52.673695 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:52.673936 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:52.718016 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:34743
I20260811 16:57:52.718111 12273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:34743 every 8 connection(s)
I20260811 16:57:52.734117 12133 heartbeater.cc:503] Master 127.10.149.126:43789 was elected leader, sending a full tablet report...
I20260811 16:57:52.737825 12274 heartbeater.cc:347] Connected to a master server at 127.10.149.126:43789
I20260811 16:57:52.738226 12274 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:52.739006 12274 heartbeater.cc:511] Master 127.10.149.126:43789 requested a full tablet report, sending...
I20260811 16:57:52.742470 11895 ts_manager.cc:194] Registered new tserver with Master: ac07452928314e8a81ff23bf78af6c13 (127.10.149.66:34743)
I20260811 16:57:52.743456 10837 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.02083389s
I20260811 16:57:52.744664 11895 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53432
I20260811 16:57:52.772030 11895 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:57:52.773622 11895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260811 16:57:52.823293 12073 tablet_service.cc:1467] Processing CreateTablet for tablet 916e87e9fcdb4683853172f324d6a043 (DEFAULT_TABLE table=test-table [id=fc5a709fd1ba46f097e713af866028c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:52.823760 12212 tablet_service.cc:1467] Processing CreateTablet for tablet 916e87e9fcdb4683853172f324d6a043 (DEFAULT_TABLE table=test-table [id=fc5a709fd1ba46f097e713af866028c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:57:52.824457 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916e87e9fcdb4683853172f324d6a043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:52.824842 12212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916e87e9fcdb4683853172f324d6a043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:52.841800 12297 tablet_bootstrap.cc:492] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: Bootstrap starting.
I20260811 16:57:52.843626 12295 tablet_bootstrap.cc:492] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: Bootstrap starting.
I20260811 16:57:52.848234 12297 tablet_bootstrap.cc:654] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:52.848697 12295 tablet_bootstrap.cc:654] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:52.849196 12274 heartbeater.cc:503] Master 127.10.149.126:43789 was elected leader, sending a full tablet report...
I20260811 16:57:52.853754 12295 tablet_bootstrap.cc:492] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: No bootstrap required, opened a new log
I20260811 16:57:52.854247 12295 ts_tablet_manager.cc:1397] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20260811 16:57:52.855724 12297 tablet_bootstrap.cc:492] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: No bootstrap required, opened a new log
I20260811 16:57:52.856312 12297 ts_tablet_manager.cc:1397] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260811 16:57:52.857192 12295 raft_consensus.cc:348] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:52.857980 12295 raft_consensus.cc:729] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac07452928314e8a81ff23bf78af6c13, State: Initialized, Role: FOLLOWER
I20260811 16:57:52.858623 12295 consensus_queue.cc:260] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:52.858947 12297 raft_consensus.cc:348] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:52.859549 12297 raft_consensus.cc:729] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Initialized, Role: FOLLOWER
I20260811 16:57:52.860222 12297 consensus_queue.cc:260] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:52.862775 12295 ts_tablet_manager.cc:1428] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: Time spent starting tablet: real 0.008s user 0.001s sys 0.007s
I20260811 16:57:52.865335 12297 ts_tablet_manager.cc:1428] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260811 16:57:52.897684 10837 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260811 16:57:52.897912 10837 raft_consensus.cc:412] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 0 FOLLOWER]: Emulating election...
I20260811 16:57:52.898099 10837 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:52.902343 10837 raft_consensus.cc:686] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 1 LEADER]: Becoming Leader. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Running, Role: LEADER
W20260811 16:57:52.902750 12133 heartbeater.cc:644] Failed to heartbeat to 127.10.149.126:43789 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260811 16:57:52.903079 10837 consensus_queue.cc:237] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:52.906463 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:52.931478 10837 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260811 16:57:53.036284 10837 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260811 16:57:53.240636 10837 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260811 16:57:53.521816 12239 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:53.528069 12310 consensus_queue.cc:1035] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:57:53.545606 10837 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260811 16:57:53.545885 10837 raft_consensus.cc:412] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 1 LEADER]: Emulating election...
I20260811 16:57:53.546109 10837 raft_consensus.cc:3032] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:57:53.546319 10837 raft_consensus.cc:729] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Running, Role: LEADER
I20260811 16:57:53.546842 10837 consensus_queue.cc:260] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:53.547535 10837 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:53.551743 10837 raft_consensus.cc:686] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 2 LEADER]: Becoming Leader. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Running, Role: LEADER
I20260811 16:57:53.552385 10837 consensus_queue.cc:237] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:53.553741 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:53.557551 10837 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260811 16:57:53.661955 10837 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260811 16:57:53.867424 10837 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260811 16:57:54.047904 12239 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:54.054816 12239 raft_consensus.cc:1261] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 2 FOLLOWER]: Refusing update from remote peer c2b3ba002678475e8c015d6f5f90c628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:57:54.056368 12310 consensus_queue.cc:1035] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:57:54.176193 10837 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260811 16:57:54.176540 10837 raft_consensus.cc:412] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 2 LEADER]: Emulating election...
I20260811 16:57:54.176858 10837 raft_consensus.cc:3032] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:57:54.177152 10837 raft_consensus.cc:729] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Running, Role: LEADER
I20260811 16:57:54.177860 10837 consensus_queue.cc:260] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:54.178956 10837 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:57:54.186368 10837 raft_consensus.cc:686] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 3 LEADER]: Becoming Leader. State: Replica: c2b3ba002678475e8c015d6f5f90c628, State: Running, Role: LEADER
I20260811 16:57:54.187141 10837 consensus_queue.cc:237] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b3ba002678475e8c015d6f5f90c628" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 39841 } } peers { permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 } }
I20260811 16:57:54.189005 10837 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260811 16:57:54.193936 10837 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260811 16:57:54.298633 10837 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260811 16:57:54.503651 10837 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260811 16:57:54.683205 12239 raft_consensus.cc:3037] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:57:54.688001 12239 raft_consensus.cc:1261] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 3 FOLLOWER]: Refusing update from remote peer c2b3ba002678475e8c015d6f5f90c628: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:57:54.689638 12328 consensus_queue.cc:1035] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07452928314e8a81ff23bf78af6c13" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:57:54.812505 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:57:54.836695 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:54.837468 10837 tablet_replica.cc:330] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628: stopping tablet replica
I20260811 16:57:54.838002 10837 raft_consensus.cc:2229] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:57:54.838608 10837 raft_consensus.cc:2258] T 916e87e9fcdb4683853172f324d6a043 P c2b3ba002678475e8c015d6f5f90c628 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:54.859242 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:57:54.870944 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:57:54.893565 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:54.894282 10837 tablet_replica.cc:330] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13: stopping tablet replica
I20260811 16:57:54.894884 10837 raft_consensus.cc:2229] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:57:54.895319 10837 raft_consensus.cc:2258] T 916e87e9fcdb4683853172f324d6a043 P ac07452928314e8a81ff23bf78af6c13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:54.904249 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:57:54.913300 10837 master.cc:537] Master@127.10.149.126:43789 shutting down...
I20260811 16:57:54.936221 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:54.936954 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:54.937289 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1d57e0fa0af2439fac13ad59d176812e: stopping tablet replica
I20260811 16:57:54.954907 10837 master.cc:552] Master@127.10.149.126:43789 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2682 ms)
[----------] 3 tests from LeadershipChangeReportingTest (11105 ms total)
[----------] 4 tests from TsTabletManagerITest
[ RUN ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260811 16:57:54.986205 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:38979
I20260811 16:57:54.987488 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:54.993567 12351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:54.994350 12352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:54.996973 12357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:54.998258 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:54.999116 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:54.999303 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:54.999411 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467474999404 us; error 0 us; skew 500 ppm
I20260811 16:57:54.999872 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:55.002713 10837 webserver.cc:460] Webserver started at http://127.10.149.126:35039/ using document root <none> and password file <none>
I20260811 16:57:55.003233 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:55.003388 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:55.003643 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:55.004818 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.009711 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 16:57:55.013165 12363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.013978 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 16:57:55.014292 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.014603 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:55.034565 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:55.036389 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:55.078047 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:38979
I20260811 16:57:55.078136 12453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:38979 every 8 connection(s)
I20260811 16:57:55.082448 12455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:55.092725 12455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801: Bootstrap starting.
I20260811 16:57:55.097323 12455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:55.102223 12455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801: No bootstrap required, opened a new log
I20260811 16:57:55.104367 12455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER }
I20260811 16:57:55.104769 12455 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:55.104941 12455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb1cff1a8cc4641a5a0df3fc7efa801, State: Initialized, Role: FOLLOWER
I20260811 16:57:55.105563 12455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER }
I20260811 16:57:55.105971 12455 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:57:55.106151 12455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:57:55.106356 12455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:55.110575 12455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER }
I20260811 16:57:55.111073 12455 leader_election.cc:302] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bb1cff1a8cc4641a5a0df3fc7efa801; no voters:
I20260811 16:57:55.112458 12455 leader_election.cc:288] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:57:55.112869 12460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:55.114521 12460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb1cff1a8cc4641a5a0df3fc7efa801, State: Running, Role: LEADER
I20260811 16:57:55.115302 12460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER }
I20260811 16:57:55.116019 12455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:57:55.118685 12461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER } }
I20260811 16:57:55.118685 12462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bb1cff1a8cc4641a5a0df3fc7efa801. Latest consensus state: current_term: 1 leader_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bb1cff1a8cc4641a5a0df3fc7efa801" member_type: VOTER } }
I20260811 16:57:55.119449 12461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:55.119709 12462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:55.122457 12468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:57:55.130550 12468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:57:55.134814 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:57:55.141036 12468 catalog_manager.cc:1347] Generated new cluster ID: 79e842561c0e4ad196fb23ab380707e6
I20260811 16:57:55.141396 12468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:57:55.161369 12468 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:57:55.163092 12468 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:57:55.175846 12468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801: Generated new TSK 0
I20260811 16:57:55.176553 12468 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:57:55.202219 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:55.208666 12490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:55.209719 12495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:55.211440 12500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:55.212592 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:55.213486 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:55.213682 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:55.213850 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467475213820 us; error 0 us; skew 500 ppm
I20260811 16:57:55.214423 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:55.217638 10837 webserver.cc:460] Webserver started at http://127.10.149.65:35645/ using document root <none> and password file <none>
I20260811 16:57:55.218187 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:55.218389 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:55.218705 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:55.220077 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "7ed05428f55841318158a92bddb7fa2f"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.225111 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260811 16:57:55.228924 12508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.229893 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:57:55.230322 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "7ed05428f55841318158a92bddb7fa2f"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.230619 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:55.248554 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:55.249910 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:55.251519 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:55.254071 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:55.254300 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.254560 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:55.254762 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.298550 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:36019
I20260811 16:57:55.298657 12609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:36019 every 8 connection(s)
I20260811 16:57:55.303561 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:55.310480 12616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:55.310945 12617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:55.314594 12623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:55.314934 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:55.316335 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:55.316628 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:55.316823 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467475316810 us; error 0 us; skew 500 ppm
I20260811 16:57:55.317446 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:55.320432 10837 webserver.cc:460] Webserver started at http://127.10.149.66:41935/ using document root <none> and password file <none>
I20260811 16:57:55.321094 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:55.321173 12610 heartbeater.cc:347] Connected to a master server at 127.10.149.126:38979
I20260811 16:57:55.321396 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:55.321659 12610 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:55.321712 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:55.322346 12610 heartbeater.cc:511] Master 127.10.149.126:38979 requested a full tablet report, sending...
I20260811 16:57:55.323022 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "8846dc579ba04f0aa869757c8a38515f"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.324556 12388 ts_manager.cc:194] Registered new tserver with Master: 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019)
I20260811 16:57:55.327212 12388 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41778
I20260811 16:57:55.329502 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 16:57:55.333266 12629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.334239 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:57:55.334501 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "8846dc579ba04f0aa869757c8a38515f"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.334777 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:55.348256 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:55.349617 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:55.351092 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:55.353437 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:55.353626 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.353878 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:55.354059 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.400624 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:42335
I20260811 16:57:55.400735 12732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:42335 every 8 connection(s)
I20260811 16:57:55.405464 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:55.413230 12736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:55.414639 12737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:55.419696 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:55.420046 12740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:55.421161 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:55.421454 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:55.421654 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467475421636 us; error 0 us; skew 500 ppm
I20260811 16:57:55.422261 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:55.422823 12733 heartbeater.cc:347] Connected to a master server at 127.10.149.126:38979
I20260811 16:57:55.423218 12733 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:55.424109 12733 heartbeater.cc:511] Master 127.10.149.126:38979 requested a full tablet report, sending...
I20260811 16:57:55.425439 10837 webserver.cc:460] Webserver started at http://127.10.149.67:39603/ using document root <none> and password file <none>
I20260811 16:57:55.426028 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:55.426189 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:55.426373 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:55.426522 12388 ts_manager.cc:194] Registered new tserver with Master: 8846dc579ba04f0aa869757c8a38515f (127.10.149.66:42335)
I20260811 16:57:55.427474 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-2-root/instance:
uuid: "13e01135a6d241188fff33ecfd4447c0"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.428540 12388 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41780
I20260811 16:57:55.432487 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 16:57:55.436395 12745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.437292 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:57:55.437626 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-2-root
uuid: "13e01135a6d241188fff33ecfd4447c0"
format_stamp: "Formatted at 2026-08-11 16:57:55 on dist-test-slave-j2vl"
I20260811 16:57:55.437883 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786467463543483-10837-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:55.455588 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:55.456830 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:55.458307 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:55.460532 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:55.460706 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.460994 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:55.461159 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:55.537876 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.67:39307
I20260811 16:57:55.538023 12853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.67:39307 every 8 connection(s)
I20260811 16:57:55.555625 12855 heartbeater.cc:347] Connected to a master server at 127.10.149.126:38979
I20260811 16:57:55.555998 12855 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:55.556636 12855 heartbeater.cc:511] Master 127.10.149.126:38979 requested a full tablet report, sending...
I20260811 16:57:55.558606 12388 ts_manager.cc:194] Registered new tserver with Master: 13e01135a6d241188fff33ecfd4447c0 (127.10.149.67:39307)
I20260811 16:57:55.559217 10837 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016600318s
I20260811 16:57:55.560248 12388 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41782
I20260811 16:57:55.587816 12388 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260811 16:57:55.590015 12388 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:57:55.643126 12550 tablet_service.cc:1467] Processing CreateTablet for tablet 514dcc672a8342d195b11bf1fc6b73be (DEFAULT_TABLE table=test-table [id=8d3ca887737f4a6a9e62ec42a7340c09]), partition=
I20260811 16:57:55.644352 12550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514dcc672a8342d195b11bf1fc6b73be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:55.649945 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 514dcc672a8342d195b11bf1fc6b73be (DEFAULT_TABLE table=test-table [id=8d3ca887737f4a6a9e62ec42a7340c09]), partition=
I20260811 16:57:55.650857 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514dcc672a8342d195b11bf1fc6b73be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:55.653152 12795 tablet_service.cc:1467] Processing CreateTablet for tablet 514dcc672a8342d195b11bf1fc6b73be (DEFAULT_TABLE table=test-table [id=8d3ca887737f4a6a9e62ec42a7340c09]), partition=
I20260811 16:57:55.654311 12795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514dcc672a8342d195b11bf1fc6b73be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:55.658646 12883 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: Bootstrap starting.
I20260811 16:57:55.664882 12883 tablet_bootstrap.cc:654] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:55.673913 12884 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: Bootstrap starting.
I20260811 16:57:55.680706 12892 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: Bootstrap starting.
I20260811 16:57:55.680770 12884 tablet_bootstrap.cc:654] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:55.680485 12883 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: No bootstrap required, opened a new log
I20260811 16:57:55.681774 12883 ts_tablet_manager.cc:1397] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.016s
I20260811 16:57:55.684974 12883 raft_consensus.cc:348] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.685696 12883 raft_consensus.cc:374] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:55.685993 12883 raft_consensus.cc:729] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed05428f55841318158a92bddb7fa2f, State: Initialized, Role: FOLLOWER
I20260811 16:57:55.686760 12883 consensus_queue.cc:260] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.687469 12884 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: No bootstrap required, opened a new log
I20260811 16:57:55.687927 12892 tablet_bootstrap.cc:654] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:55.687942 12884 ts_tablet_manager.cc:1397] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260811 16:57:55.690573 12610 heartbeater.cc:503] Master 127.10.149.126:38979 was elected leader, sending a full tablet report...
I20260811 16:57:55.691099 12883 ts_tablet_manager.cc:1428] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260811 16:57:55.691375 12884 raft_consensus.cc:348] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.692142 12884 raft_consensus.cc:374] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:55.692433 12884 raft_consensus.cc:729] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846dc579ba04f0aa869757c8a38515f, State: Initialized, Role: FOLLOWER
I20260811 16:57:55.695605 12884 consensus_queue.cc:260] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.700326 12733 heartbeater.cc:503] Master 127.10.149.126:38979 was elected leader, sending a full tablet report...
I20260811 16:57:55.700631 12892 tablet_bootstrap.cc:492] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: No bootstrap required, opened a new log
I20260811 16:57:55.701122 12892 ts_tablet_manager.cc:1397] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.008s
I20260811 16:57:55.701258 12884 ts_tablet_manager.cc:1428] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: Time spent starting tablet: real 0.013s user 0.010s sys 0.000s
I20260811 16:57:55.702211 12894 raft_consensus.cc:482] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:57:55.703202 12894 raft_consensus.cc:504] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.704959 12892 raft_consensus.cc:348] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.705924 12892 raft_consensus.cc:374] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:55.706243 12892 raft_consensus.cc:729] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e01135a6d241188fff33ecfd4447c0, State: Initialized, Role: FOLLOWER
I20260811 16:57:55.707624 12894 leader_election.cc:288] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846dc579ba04f0aa869757c8a38515f (127.10.149.66:42335), 13e01135a6d241188fff33ecfd4447c0 (127.10.149.67:39307)
I20260811 16:57:55.707757 12892 consensus_queue.cc:260] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.716061 12892 ts_tablet_manager.cc:1428] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: Time spent starting tablet: real 0.014s user 0.006s sys 0.007s
I20260811 16:57:55.716270 12855 heartbeater.cc:503] Master 127.10.149.126:38979 was elected leader, sending a full tablet report...
I20260811 16:57:55.723554 12693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "7ed05428f55841318158a92bddb7fa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846dc579ba04f0aa869757c8a38515f" is_pre_election: true
I20260811 16:57:55.724773 12693 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ed05428f55841318158a92bddb7fa2f in term 0.
I20260811 16:57:55.726303 12511 leader_election.cc:302] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ed05428f55841318158a92bddb7fa2f, 8846dc579ba04f0aa869757c8a38515f; no voters:
I20260811 16:57:55.727197 12894 raft_consensus.cc:2781] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:57:55.727563 12894 raft_consensus.cc:482] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:57:55.727931 12894 raft_consensus.cc:3037] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:55.733197 12812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "7ed05428f55841318158a92bddb7fa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e01135a6d241188fff33ecfd4447c0" is_pre_election: true
I20260811 16:57:55.733975 12812 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ed05428f55841318158a92bddb7fa2f in term 0.
I20260811 16:57:55.735201 12894 raft_consensus.cc:504] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.737375 12894 leader_election.cc:288] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8846dc579ba04f0aa869757c8a38515f (127.10.149.66:42335), 13e01135a6d241188fff33ecfd4447c0 (127.10.149.67:39307)
I20260811 16:57:55.738183 12693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "7ed05428f55841318158a92bddb7fa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846dc579ba04f0aa869757c8a38515f"
I20260811 16:57:55.738330 12812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "7ed05428f55841318158a92bddb7fa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e01135a6d241188fff33ecfd4447c0"
I20260811 16:57:55.738682 12693 raft_consensus.cc:3037] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:55.738921 12812 raft_consensus.cc:3037] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:55.744768 12693 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ed05428f55841318158a92bddb7fa2f in term 1.
I20260811 16:57:55.745443 12812 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ed05428f55841318158a92bddb7fa2f in term 1.
I20260811 16:57:55.745918 12511 leader_election.cc:302] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ed05428f55841318158a92bddb7fa2f, 8846dc579ba04f0aa869757c8a38515f; no voters:
I20260811 16:57:55.746727 12894 raft_consensus.cc:2781] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:55.747617 12894 raft_consensus.cc:686] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 1 LEADER]: Becoming Leader. State: Replica: 7ed05428f55841318158a92bddb7fa2f, State: Running, Role: LEADER
I20260811 16:57:55.748399 12894 consensus_queue.cc:237] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:55.757308 12386 catalog_manager.cc:5495] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ed05428f55841318158a92bddb7fa2f (127.10.149.65). New cstate: current_term: 1 leader_uuid: "7ed05428f55841318158a92bddb7fa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } health_report { overall_health: UNKNOWN } } }
I20260811 16:57:56.139139 12894 consensus_queue.cc:1035] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:57:56.150315 12900 consensus_queue.cc:1035] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:57:56.833969 10837 tablet_replica.cc:330] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f: stopping tablet replica
I20260811 16:57:56.834560 10837 raft_consensus.cc:2229] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:56.835355 10837 raft_consensus.cc:2258] T 514dcc672a8342d195b11bf1fc6b73be P 7ed05428f55841318158a92bddb7fa2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:58.132879 12926 raft_consensus.cc:482] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ed05428f55841318158a92bddb7fa2f)
I20260811 16:57:58.133440 12926 raft_consensus.cc:504] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:58.135887 12926 leader_election.cc:288] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019), 8846dc579ba04f0aa869757c8a38515f (127.10.149.66:42335)
I20260811 16:57:58.153177 12569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "13e01135a6d241188fff33ecfd4447c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ed05428f55841318158a92bddb7fa2f" is_pre_election: true
I20260811 16:57:58.154783 12693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "13e01135a6d241188fff33ecfd4447c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846dc579ba04f0aa869757c8a38515f" is_pre_election: true
W20260811 16:57:58.154878 12748 leader_election.cc:341] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019): Illegal state: cannot vote while shut down
I20260811 16:57:58.156471 12748 leader_election.cc:302] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13e01135a6d241188fff33ecfd4447c0; no voters: 7ed05428f55841318158a92bddb7fa2f, 8846dc579ba04f0aa869757c8a38515f
I20260811 16:57:58.157255 12926 raft_consensus.cc:2726] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:57:58.192243 12934 raft_consensus.cc:482] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ed05428f55841318158a92bddb7fa2f)
I20260811 16:57:58.192788 12934 raft_consensus.cc:504] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:58.195052 12934 leader_election.cc:288] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019), 13e01135a6d241188fff33ecfd4447c0 (127.10.149.67:39307)
I20260811 16:57:58.211378 12569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "8846dc579ba04f0aa869757c8a38515f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ed05428f55841318158a92bddb7fa2f" is_pre_election: true
W20260811 16:57:58.212863 12633 leader_election.cc:341] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019): Illegal state: cannot vote while shut down
I20260811 16:57:58.213657 12812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "8846dc579ba04f0aa869757c8a38515f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13e01135a6d241188fff33ecfd4447c0" is_pre_election: true
I20260811 16:57:58.214198 12812 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846dc579ba04f0aa869757c8a38515f in term 1.
I20260811 16:57:58.215387 12634 leader_election.cc:302] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e01135a6d241188fff33ecfd4447c0, 8846dc579ba04f0aa869757c8a38515f; no voters: 7ed05428f55841318158a92bddb7fa2f
I20260811 16:57:58.216480 12934 raft_consensus.cc:2781] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:57:58.216969 12934 raft_consensus.cc:482] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ed05428f55841318158a92bddb7fa2f)
I20260811 16:57:58.217832 12934 raft_consensus.cc:3037] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:57:58.223161 12934 raft_consensus.cc:504] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:58.224792 12934 leader_election.cc:288] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 election: Requested vote from peers 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019), 13e01135a6d241188fff33ecfd4447c0 (127.10.149.67:39307)
I20260811 16:57:58.226204 12812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "8846dc579ba04f0aa869757c8a38515f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13e01135a6d241188fff33ecfd4447c0"
I20260811 16:57:58.226181 12569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514dcc672a8342d195b11bf1fc6b73be" candidate_uuid: "8846dc579ba04f0aa869757c8a38515f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ed05428f55841318158a92bddb7fa2f"
I20260811 16:57:58.226958 12812 raft_consensus.cc:3037] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:57:58.227735 12633 leader_election.cc:341] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019): Illegal state: cannot vote while shut down
I20260811 16:57:58.232030 12812 raft_consensus.cc:2454] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846dc579ba04f0aa869757c8a38515f in term 2.
I20260811 16:57:58.233170 12634 leader_election.cc:302] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13e01135a6d241188fff33ecfd4447c0, 8846dc579ba04f0aa869757c8a38515f; no voters: 7ed05428f55841318158a92bddb7fa2f
I20260811 16:57:58.233924 12934 raft_consensus.cc:2781] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:57:58.235364 12934 raft_consensus.cc:686] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 2 LEADER]: Becoming Leader. State: Replica: 8846dc579ba04f0aa869757c8a38515f, State: Running, Role: LEADER
I20260811 16:57:58.236091 12934 consensus_queue.cc:237] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed05428f55841318158a92bddb7fa2f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 36019 } } peers { permanent_uuid: "8846dc579ba04f0aa869757c8a38515f" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 42335 } } peers { permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 } }
I20260811 16:57:58.665012 12812 raft_consensus.cc:1261] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 2 FOLLOWER]: Refusing update from remote peer 8846dc579ba04f0aa869757c8a38515f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:57:58.666352 12934 consensus_queue.cc:1035] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e01135a6d241188fff33ecfd4447c0" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 39307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:57:58.677011 12633 consensus_queue.cc:579] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [LEADER]: The tablet replica hosted on peer 7ed05428f55841318158a92bddb7fa2f has failed
W20260811 16:57:58.677563 12633 consensus_peers.cc:487] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f -> Peer 7ed05428f55841318158a92bddb7fa2f (127.10.149.65:36019): Couldn't send request to peer 7ed05428f55841318158a92bddb7fa2f. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:57:58.875313 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:57:58.901999 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:58.920625 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:57:58.930117 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:57:58.949481 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:58.950253 10837 tablet_replica.cc:330] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f: stopping tablet replica
I20260811 16:57:58.951017 10837 raft_consensus.cc:2229] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:57:58.952105 10837 raft_consensus.cc:2258] T 514dcc672a8342d195b11bf1fc6b73be P 8846dc579ba04f0aa869757c8a38515f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:58.973827 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:57:58.983443 10837 tablet_server.cc:178] TabletServer@127.10.149.67:0 shutting down...
I20260811 16:57:59.005802 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:59.006567 10837 tablet_replica.cc:330] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0: stopping tablet replica
I20260811 16:57:59.007128 10837 raft_consensus.cc:2229] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:57:59.007566 10837 raft_consensus.cc:2258] T 514dcc672a8342d195b11bf1fc6b73be P 13e01135a6d241188fff33ecfd4447c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:59.028813 10837 tablet_server.cc:194] TabletServer@127.10.149.67:0 shutdown complete.
I20260811 16:57:59.038610 10837 master.cc:537] Master@127.10.149.126:38979 shutting down...
I20260811 16:57:59.057926 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:59.058504 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:59.059158 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4bb1cff1a8cc4641a5a0df3fc7efa801: stopping tablet replica
I20260811 16:57:59.080900 10837 master.cc:552] Master@127.10.149.126:38979 shutdown complete.
[ OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (4122 ms)
[ RUN ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260811 16:57:59.108150 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:34415
I20260811 16:57:59.109210 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:59.114564 12960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.115989 12963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.118891 12968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.119138 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:59.120116 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:59.120594 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:59.120813 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467479120798 us; error 0 us; skew 500 ppm
I20260811 16:57:59.121773 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:59.129264 10837 webserver.cc:460] Webserver started at http://127.10.149.126:43733/ using document root <none> and password file <none>
I20260811 16:57:59.129908 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:59.130100 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:59.130393 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:59.131510 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "633d018469da4fb4a8f8a54f2009173b"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.136194 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 16:57:59.139707 12977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.140668 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 16:57:59.141016 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "633d018469da4fb4a8f8a54f2009173b"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.141310 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:59.156795 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:59.158185 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:59.203781 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:34415
I20260811 16:57:59.204056 13077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:34415 every 8 connection(s)
I20260811 16:57:59.208454 13078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:59.219672 13078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b: Bootstrap starting.
I20260811 16:57:59.223995 13078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b: Neither blocks nor log segments found. Creating new log.
I20260811 16:57:59.228428 13078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b: No bootstrap required, opened a new log
I20260811 16:57:59.230679 13078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER }
I20260811 16:57:59.231105 13078 raft_consensus.cc:374] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:57:59.231371 13078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 633d018469da4fb4a8f8a54f2009173b, State: Initialized, Role: FOLLOWER
I20260811 16:57:59.232012 13078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER }
I20260811 16:57:59.232511 13078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:57:59.232728 13078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:57:59.232998 13078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:57:59.237635 13078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER }
I20260811 16:57:59.238214 13078 leader_election.cc:302] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 633d018469da4fb4a8f8a54f2009173b; no voters:
I20260811 16:57:59.239569 13078 leader_election.cc:288] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:57:59.239977 13088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:57:59.241410 13088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 1 LEADER]: Becoming Leader. State: Replica: 633d018469da4fb4a8f8a54f2009173b, State: Running, Role: LEADER
I20260811 16:57:59.242666 13078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:57:59.242340 13088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER }
I20260811 16:57:59.245590 13089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "633d018469da4fb4a8f8a54f2009173b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER } }
I20260811 16:57:59.245625 13091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 633d018469da4fb4a8f8a54f2009173b. Latest consensus state: current_term: 1 leader_uuid: "633d018469da4fb4a8f8a54f2009173b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633d018469da4fb4a8f8a54f2009173b" member_type: VOTER } }
I20260811 16:57:59.246469 13091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:59.247025 13089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [sys.catalog]: This master's current role is: LEADER
I20260811 16:57:59.250608 13097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:57:59.255569 13097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:57:59.258910 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:57:59.265142 13097 catalog_manager.cc:1347] Generated new cluster ID: a3b72ac4346c43de9c4864e59330babd
I20260811 16:57:59.265475 13097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:57:59.291185 13097 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:57:59.293289 13097 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:57:59.306087 13097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b: Generated new TSK 0
I20260811 16:57:59.306790 13097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:57:59.326809 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:59.333236 13119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.334280 13120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.337917 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:59.340441 13124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.341626 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:59.341866 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:59.342054 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467479342033 us; error 0 us; skew 500 ppm
I20260811 16:57:59.342684 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:59.347111 10837 webserver.cc:460] Webserver started at http://127.10.149.65:41539/ using document root <none> and password file <none>
I20260811 16:57:59.347759 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:59.347994 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:59.348418 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:59.349824 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "1a1bada610ce4aba84f593cb108873f3"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.355366 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 16:57:59.359947 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.361107 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:57:59.361598 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "1a1bada610ce4aba84f593cb108873f3"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.362035 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:59.392366 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:59.393716 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:59.395493 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:59.398157 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:59.398428 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.398701 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:59.398872 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.455380 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:39221
I20260811 16:57:59.455477 13239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:39221 every 8 connection(s)
I20260811 16:57:59.482636 13243 heartbeater.cc:347] Connected to a master server at 127.10.149.126:34415
I20260811 16:57:59.483139 13243 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:59.484197 13243 heartbeater.cc:511] Master 127.10.149.126:34415 requested a full tablet report, sending...
I20260811 16:57:59.486900 13004 ts_manager.cc:194] Registered new tserver with Master: 1a1bada610ce4aba84f593cb108873f3 (127.10.149.65:39221)
I20260811 16:57:59.487071 10837 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.024515594s
I20260811 16:57:59.489653 13004 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60092
I20260811 16:57:59.513708 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:57:59.534013 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:59.551932 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:57:59.561451 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:57:59.564100 10837 tablet_server.cc:93] deduplicated master addresses: 127.10.149.126:34415
W20260811 16:57:59.567736 13257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.569250 13258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.571532 10837 server_base.cc:1034] running on GCE node
W20260811 16:57:59.571493 13262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.572926 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:59.573158 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:59.573294 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467479573285 us; error 0 us; skew 500 ppm
I20260811 16:57:59.573920 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:59.577059 10837 webserver.cc:460] Webserver started at http://127.10.149.65:41539/ using document root <none> and password file <none>
I20260811 16:57:59.577766 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:59.577930 10837 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260811 16:57:59.582585 10837 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 16:57:59.586385 13276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.587484 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 16:57:59.587870 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "1a1bada610ce4aba84f593cb108873f3"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.588217 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:59.601706 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:59.602806 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:59.604378 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:57:59.606842 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:57:59.607024 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.607318 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:57:59.607456 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.653038 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:39221
I20260811 16:57:59.653311 13381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:39221 every 8 connection(s)
I20260811 16:57:59.662539 10837 tablet_server.cc:178] TabletServer@127.10.149.65:39221 shutting down...
I20260811 16:57:59.682324 13383 heartbeater.cc:347] Connected to a master server at 127.10.149.126:34415
I20260811 16:57:59.682753 13383 heartbeater.cc:464] Registering TS with master...
I20260811 16:57:59.683841 13383 heartbeater.cc:511] Master 127.10.149.126:34415 requested a full tablet report, sending...
I20260811 16:57:59.687075 13004 ts_manager.cc:194] Re-registered known tserver with Master: 1a1bada610ce4aba84f593cb108873f3 (127.10.149.65:39221)
I20260811 16:57:59.689675 13004 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60110
I20260811 16:57:59.693226 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:57:59.711354 10837 tablet_server.cc:194] TabletServer@127.10.149.65:39221 shutdown complete.
I20260811 16:57:59.719822 10837 master.cc:537] Master@127.10.149.126:34415 shutting down...
I20260811 16:57:59.735904 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:57:59.736445 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:57:59.736836 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 633d018469da4fb4a8f8a54f2009173b: stopping tablet replica
I20260811 16:57:59.756807 10837 master.cc:552] Master@127.10.149.126:34415 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (673 ms)
[ RUN ] TsTabletManagerITest.TestTableStats
I20260811 16:57:59.781759 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:42349,127.10.149.125:37675,127.10.149.124:32857
I20260811 16:57:59.783069 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:59.789299 13393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.790170 13396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.791846 13401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.792934 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:59.793830 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:59.794010 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:59.794114 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467479794106 us; error 0 us; skew 500 ppm
I20260811 16:57:59.794564 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:59.797256 10837 webserver.cc:460] Webserver started at http://127.10.149.126:44679/ using document root <none> and password file <none>
I20260811 16:57:59.797892 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:59.798183 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:59.798439 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:59.799538 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.804122 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 16:57:59.807699 13408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.808529 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:57:59.808794 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.809063 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:57:59.831049 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:59.832050 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:59.870391 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:42349
I20260811 16:57:59.870517 13498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:42349 every 8 connection(s)
I20260811 16:57:59.874351 13499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:57:59.874462 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:57:59.880115 13501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:57:59.881291 13502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.882414 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:57:59.883064 13504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:57:59.884038 10837 server_base.cc:1034] running on GCE node
I20260811 16:57:59.885861 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:57:59.886212 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:57:59.886415 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467479886401 us; error 0 us; skew 500 ppm
I20260811 16:57:59.887181 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:57:59.890626 10837 webserver.cc:460] Webserver started at http://127.10.149.125:37977/ using document root <none> and password file <none>
I20260811 16:57:59.891175 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:57:59.891383 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:57:59.891656 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:57:59.892835 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-1-root/instance:
uuid: "e320a31507574e6690347aa60ee9dd01"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.899451 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 16:57:59.900722 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:57:59.903271 13410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.149.125:37675: connect: Connection refused (error 111)
I20260811 16:57:59.903883 13516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:57:59.905133 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 16:57:59.905485 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-1-root
uuid: "e320a31507574e6690347aa60ee9dd01"
format_stamp: "Formatted at 2026-08-11 16:57:59 on dist-test-slave-j2vl"
I20260811 16:57:59.905786 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 16:57:59.907143 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.125:37675: Network error: Client connection negotiation failed: client connection to 127.10.149.125:37675: connect: Connection refused (error 111)
I20260811 16:57:59.945734 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } attempt: 1
W20260811 16:57:59.950456 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.125:37675: Network error: Client connection negotiation failed: client connection to 127.10.149.125:37675: connect: Connection refused (error 111)
I20260811 16:57:59.956689 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:57:59.957911 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:57:59.990969 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } attempt: 2
W20260811 16:57:59.995713 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.125:37675: Network error: Client connection negotiation failed: client connection to 127.10.149.125:37675: connect: Connection refused (error 111)
I20260811 16:58:00.002776 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.125:37675
I20260811 16:58:00.002889 13593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.125:37675 every 8 connection(s)
I20260811 16:58:00.006759 13595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:00.006907 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:00.013134 13598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:00.013479 13600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.015123 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:58:00.017902 13604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.023065 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:00.024209 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:00.024482 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:00.024669 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467480024654 us; error 0 us; skew 500 ppm
I20260811 16:58:00.025439 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:00.028573 10837 webserver.cc:460] Webserver started at http://127.10.149.124:42155/ using document root <none> and password file <none>
I20260811 16:58:00.029214 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:00.029500 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:00.029781 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:00.031157 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-2-root/instance:
uuid: "ed5c1ce9a8dc42fdbd2e074116464c07"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.036095 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:58:00.037835 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260811 16:58:00.042183 13616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.043074 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260811 16:58:00.043452 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-2-root
uuid: "ed5c1ce9a8dc42fdbd2e074116464c07"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.043776 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:00.051616 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:58:00.056689 13595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.124:32857: Network error: Client connection negotiation failed: client connection to 127.10.149.124:32857: connect: Connection refused (error 111)
I20260811 16:58:00.061474 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:00.062525 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:00.079249 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } attempt: 3
I20260811 16:58:00.090217 13595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } attempt: 1
W20260811 16:58:00.096050 13595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.124:32857: Network error: Client connection negotiation failed: client connection to 127.10.149.124:32857: connect: Connection refused (error 111)
I20260811 16:58:00.096645 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:58:00.100723 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.149.124:32857: Network error: Client connection negotiation failed: client connection to 127.10.149.124:32857: connect: Connection refused (error 111)
I20260811 16:58:00.109545 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.124:32857
I20260811 16:58:00.109738 13705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.124:32857 every 8 connection(s)
I20260811 16:58:00.112995 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:00.113727 13706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:00.119921 13706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:58:00.123342 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } attempt: 1
I20260811 16:58:00.134688 13706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:58:00.144634 13499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: Bootstrap starting.
I20260811 16:58:00.148553 13706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:58:00.151144 13499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:00.156302 13499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: No bootstrap required, opened a new log
I20260811 16:58:00.159219 13499 raft_consensus.cc:348] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.160009 13499 raft_consensus.cc:374] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:00.160315 13499 raft_consensus.cc:729] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aadbf3c4b9d7495dbb76c1e2aebc2ab6, State: Initialized, Role: FOLLOWER
I20260811 16:58:00.160962 13499 consensus_queue.cc:260] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.163166 13714 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.163844 13714 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.165010 13499 sys_catalog.cc:564] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:00.171635 13595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } attempt: 2
I20260811 16:58:00.171972 13706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: Bootstrap starting.
I20260811 16:58:00.178128 13706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:00.184872 13706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: No bootstrap required, opened a new log
I20260811 16:58:00.187582 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260811 16:58:00.188408 13706 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.189193 13706 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:00.189539 13706 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5c1ce9a8dc42fdbd2e074116464c07, State: Initialized, Role: FOLLOWER
I20260811 16:58:00.190227 13706 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
W20260811 16:58:00.191411 13734 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:58:00.191699 13734 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:58:00.194448 13714 raft_consensus.cc:482] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:00.194164 13735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.195307 13735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.195220 13714 raft_consensus.cc:504] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.195834 13706 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:00.197121 13595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: Bootstrap starting.
I20260811 16:58:00.197324 13714 leader_election.cc:288] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:00.198971 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:00.199725 13666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 0.
I20260811 16:58:00.201053 13409 leader_election.cc:302] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07; no voters:
I20260811 16:58:00.202349 13714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:00.202711 13714 raft_consensus.cc:482] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:00.203047 13714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:00.204492 13595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:00.211396 13714 raft_consensus.cc:504] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.213614 13714 leader_election.cc:288] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 1 election: Requested vote from peers e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:00.213855 13595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: No bootstrap required, opened a new log
I20260811 16:58:00.215807 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07"
I20260811 16:58:00.216748 13666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:00.217118 13595 raft_consensus.cc:348] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.217917 13595 raft_consensus.cc:374] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:00.218189 13595 raft_consensus.cc:729] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e320a31507574e6690347aa60ee9dd01, State: Initialized, Role: FOLLOWER
I20260811 16:58:00.218901 13595 consensus_queue.cc:260] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.223623 13595 sys_catalog.cc:564] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:00.223706 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:00.224452 13557 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 0.
I20260811 16:58:00.225435 13556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01"
I20260811 16:58:00.226054 13556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:00.227320 13666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 1.
I20260811 16:58:00.229084 13409 leader_election.cc:302] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07; no voters:
I20260811 16:58:00.230360 13714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:00.232069 13714 raft_consensus.cc:686] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 LEADER]: Becoming Leader. State: Replica: aadbf3c4b9d7495dbb76c1e2aebc2ab6, State: Running, Role: LEADER
I20260811 16:58:00.233108 13714 consensus_queue.cc:237] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:00.222565 13745 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.236570 13745 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.238102 13556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 1.
I20260811 16:58:00.240916 13748 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.241895 13748 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:00.244946 13752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:00.254552 13752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:00.255542 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260811 16:58:00.259547 13778 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:58:00.259970 13778 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:58:00.261840 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:00.264292 13782 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:58:00.264719 13782 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:58:00.267041 13666 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Refusing update from remote peer aadbf3c4b9d7495dbb76c1e2aebc2ab6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:58:00.267555 13556 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Refusing update from remote peer aadbf3c4b9d7495dbb76c1e2aebc2ab6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:58:00.269325 13748 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:00.270344 13714 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:58:00.272570 13784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:00.274667 13785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.288039 13735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
W20260811 16:58:00.288689 13792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.288923 13735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.289944 13745 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.290678 13745 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.290833 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:00.291837 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:00.292068 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:00.292245 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467480292231 us; error 0 us; skew 500 ppm
I20260811 16:58:00.293192 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:00.293545 13748 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.294670 13748 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:00.295186 13794 mvcc.cc:205] Tried to move back new op lower bound from 7317370799159070720 to 7317370799052558336. Current Snapshot: MvccSnapshot[applied={T|T < 7317370799159070720}]
I20260811 16:58:00.295966 13748 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.296733 13748 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:00.299180 13752 catalog_manager.cc:1347] Generated new cluster ID: 9652a7237cae44988a70481d76d72f21
I20260811 16:58:00.299494 13752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:00.303980 13745 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.305061 13745 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.308702 10837 webserver.cc:460] Webserver started at http://127.10.149.65:42517/ using document root <none> and password file <none>
I20260811 16:58:00.308666 13735 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:00.309665 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:00.309752 13735 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:00.309976 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:00.310349 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:00.311718 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.318336 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 16:58:00.323360 13817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.324458 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260811 16:58:00.324887 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.325593 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:00.331950 13752 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:00.335151 13752 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:00.356745 13752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: Generated new TSK 0
I20260811 16:58:00.357831 13752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:00.359678 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:00.361192 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:00.363587 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:00.366546 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:00.366804 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.367127 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:00.367296 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.416728 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:34679
I20260811 16:58:00.416759 13914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:34679 every 8 connection(s)
I20260811 16:58:00.432780 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:00.450958 13928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:00.453790 13930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.458856 13917 heartbeater.cc:347] Connected to a master server at 127.10.149.125:37675
I20260811 16:58:00.459303 13917 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.460450 13917 heartbeater.cc:511] Master 127.10.149.125:37675 requested a full tablet report, sending...
I20260811 16:58:00.470244 13915 heartbeater.cc:347] Connected to a master server at 127.10.149.124:32857
I20260811 16:58:00.470752 13915 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.471724 13915 heartbeater.cc:511] Master 127.10.149.124:32857 requested a full tablet report, sending...
I20260811 16:58:00.472216 13542 ts_manager.cc:194] Registered new tserver with Master: 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
W20260811 16:58:00.473609 13932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.475531 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:00.475721 13643 ts_manager.cc:194] Registered new tserver with Master: 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:00.476686 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:00.477077 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:00.477314 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467480477298 us; error 0 us; skew 500 ppm
I20260811 16:58:00.478222 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:00.480819 13918 heartbeater.cc:347] Connected to a master server at 127.10.149.126:42349
I20260811 16:58:00.481380 13918 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.481652 10837 webserver.cc:460] Webserver started at http://127.10.149.66:35511/ using document root <none> and password file <none>
I20260811 16:58:00.482295 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:00.482251 13918 heartbeater.cc:511] Master 127.10.149.126:42349 requested a full tablet report, sending...
I20260811 16:58:00.482661 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:00.483004 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:00.484208 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "2505f2b1878341cabe053fde06071180"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.485177 13437 ts_manager.cc:194] Registered new tserver with Master: 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:00.488337 13437 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38850
I20260811 16:58:00.490944 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 16:58:00.495487 13943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.496803 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:58:00.497123 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "2505f2b1878341cabe053fde06071180"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.497455 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:00.511699 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:00.513051 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:00.515275 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:00.518530 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:00.518729 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.518981 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:00.519099 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.592444 13918 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:00.611094 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:32863
I20260811 16:58:00.611197 14054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:32863 every 8 connection(s)
I20260811 16:58:00.625378 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:00.643664 14070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:00.647024 14072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.649014 14058 heartbeater.cc:347] Connected to a master server at 127.10.149.124:32857
I20260811 16:58:00.649652 14058 heartbeater.cc:464] Registering TS with master...
W20260811 16:58:00.649587 14075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:00.650501 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:00.651999 14058 heartbeater.cc:511] Master 127.10.149.124:32857 requested a full tablet report, sending...
I20260811 16:58:00.652124 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:00.652486 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:00.652698 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467480652684 us; error 0 us; skew 500 ppm
I20260811 16:58:00.653541 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:00.656028 13643 ts_manager.cc:194] Registered new tserver with Master: 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:00.659593 10837 webserver.cc:460] Webserver started at http://127.10.149.67:44749/ using document root <none> and password file <none>
I20260811 16:58:00.659768 14059 heartbeater.cc:347] Connected to a master server at 127.10.149.125:37675
I20260811 16:58:00.660275 14059 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.660368 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:00.660719 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:00.661018 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:00.661239 14059 heartbeater.cc:511] Master 127.10.149.125:37675 requested a full tablet report, sending...
I20260811 16:58:00.662551 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-2-root/instance:
uuid: "76919c05073a4939984a36038b72c2a4"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.664968 13542 ts_manager.cc:194] Registered new tserver with Master: 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:00.665854 14064 heartbeater.cc:347] Connected to a master server at 127.10.149.126:42349
I20260811 16:58:00.666268 14064 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.667253 14064 heartbeater.cc:511] Master 127.10.149.126:42349 requested a full tablet report, sending...
I20260811 16:58:00.669272 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 16:58:00.669907 13437 ts_manager.cc:194] Registered new tserver with Master: 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:00.672075 13437 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38866
I20260811 16:58:00.673864 14082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.674829 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 16:58:00.675210 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-2-root
uuid: "76919c05073a4939984a36038b72c2a4"
format_stamp: "Formatted at 2026-08-11 16:58:00 on dist-test-slave-j2vl"
I20260811 16:58:00.675521 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:00.701785 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:00.703064 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:00.704245 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:00.706593 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:00.706821 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.707022 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:00.707145 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:00.775652 14064 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:00.798765 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.67:35599
I20260811 16:58:00.798907 14203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.67:35599 every 8 connection(s)
I20260811 16:58:00.829170 14206 heartbeater.cc:347] Connected to a master server at 127.10.149.124:32857
I20260811 16:58:00.829695 14206 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.830580 14206 heartbeater.cc:511] Master 127.10.149.124:32857 requested a full tablet report, sending...
I20260811 16:58:00.834841 13643 ts_manager.cc:194] Registered new tserver with Master: 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:00.839708 14207 heartbeater.cc:347] Connected to a master server at 127.10.149.125:37675
I20260811 16:58:00.840197 14207 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.841197 14210 heartbeater.cc:347] Connected to a master server at 127.10.149.126:42349
I20260811 16:58:00.841229 14207 heartbeater.cc:511] Master 127.10.149.125:37675 requested a full tablet report, sending...
I20260811 16:58:00.841799 14210 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:00.842666 14210 heartbeater.cc:511] Master 127.10.149.126:42349 requested a full tablet report, sending...
I20260811 16:58:00.844261 13542 ts_manager.cc:194] Registered new tserver with Master: 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:00.844901 13437 ts_manager.cc:194] Registered new tserver with Master: 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:00.845206 10837 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.024874443s
I20260811 16:58:00.847376 13437 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38882
I20260811 16:58:00.904994 13437 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260811 16:58:00.907055 13437 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:58:00.951788 14210 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:01.048828 13989 tablet_service.cc:1467] Processing CreateTablet for tablet c670d49aabef48b1b1aa3a3c355b7558 (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.050535 13989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c670d49aabef48b1b1aa3a3c355b7558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.051074 13863 tablet_service.cc:1467] Processing CreateTablet for tablet c670d49aabef48b1b1aa3a3c355b7558 (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.051807 13862 tablet_service.cc:1467] Processing CreateTablet for tablet 56b0537688054a8a98470218be6f413e (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.052595 13863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c670d49aabef48b1b1aa3a3c355b7558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.053330 13862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b0537688054a8a98470218be6f413e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.054013 13861 tablet_service.cc:1467] Processing CreateTablet for tablet 4789cbc55f324255b7e296755cd69dca (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.055932 13861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4789cbc55f324255b7e296755cd69dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.061586 13987 tablet_service.cc:1467] Processing CreateTablet for tablet 56b0537688054a8a98470218be6f413e (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.061744 13984 tablet_service.cc:1467] Processing CreateTablet for tablet 4789cbc55f324255b7e296755cd69dca (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.063170 13987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b0537688054a8a98470218be6f413e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.064939 13984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4789cbc55f324255b7e296755cd69dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.090003 14140 tablet_service.cc:1467] Processing CreateTablet for tablet 56b0537688054a8a98470218be6f413e (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.091801 14141 tablet_service.cc:1467] Processing CreateTablet for tablet c670d49aabef48b1b1aa3a3c355b7558 (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.095227 14138 tablet_service.cc:1467] Processing CreateTablet for tablet 4789cbc55f324255b7e296755cd69dca (DEFAULT_TABLE table=test-table [id=974e15145d3b497db94849e0e4244426]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:01.097008 14141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c670d49aabef48b1b1aa3a3c355b7558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.108018 14252 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Bootstrap starting.
I20260811 16:58:01.110793 14140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b0537688054a8a98470218be6f413e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.117295 14138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4789cbc55f324255b7e296755cd69dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:01.144776 14252 tablet_bootstrap.cc:654] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.150720 14254 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: Bootstrap starting.
I20260811 16:58:01.152194 14257 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: Bootstrap starting.
I20260811 16:58:01.159106 14254 tablet_bootstrap.cc:654] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.163436 14257 tablet_bootstrap.cc:654] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.165648 14252 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: No bootstrap required, opened a new log
I20260811 16:58:01.166393 14252 ts_tablet_manager.cc:1397] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent bootstrapping tablet: real 0.059s user 0.016s sys 0.002s
I20260811 16:58:01.169435 14252 raft_consensus.cc:348] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.170334 14252 raft_consensus.cc:374] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.170667 14252 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.172027 14254 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: No bootstrap required, opened a new log
I20260811 16:58:01.171401 14252 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.172518 14254 ts_tablet_manager.cc:1397] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.005s
I20260811 16:58:01.176486 14254 raft_consensus.cc:348] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.177291 14254 raft_consensus.cc:374] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.177696 14254 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.178351 14254 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.183363 14257 tablet_bootstrap.cc:492] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: No bootstrap required, opened a new log
I20260811 16:58:01.183938 14257 ts_tablet_manager.cc:1397] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.004s
I20260811 16:58:01.186902 14257 raft_consensus.cc:348] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.188301 14257 raft_consensus.cc:374] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.188606 14257 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.189275 14257 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.193856 14254 ts_tablet_manager.cc:1428] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: Time spent starting tablet: real 0.021s user 0.007s sys 0.013s
I20260811 16:58:01.194950 14264 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.195505 14264 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.197628 14252 ts_tablet_manager.cc:1428] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent starting tablet: real 0.031s user 0.012s sys 0.003s
I20260811 16:58:01.198411 14254 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Bootstrap starting.
I20260811 16:58:01.203416 14252 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: Bootstrap starting.
I20260811 16:58:01.233736 14262 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.241127 14252 tablet_bootstrap.cc:654] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.235800 14262 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.259084 14264 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:01.258755 14262 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:01.272018 14257 ts_tablet_manager.cc:1428] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: Time spent starting tablet: real 0.088s user 0.023s sys 0.025s
I20260811 16:58:01.275703 14254 tablet_bootstrap.cc:654] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.276652 14257 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: Bootstrap starting.
I20260811 16:58:01.279157 14267 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.319270 13782 catalog_manager.cc:1259] Loaded cluster ID: 9652a7237cae44988a70481d76d72f21
I20260811 16:58:01.324757 13782 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: loading cluster ID for follower catalog manager: success
I20260811 16:58:01.312811 14267 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.349020 13778 catalog_manager.cc:1259] Loaded cluster ID: 9652a7237cae44988a70481d76d72f21
I20260811 16:58:01.349592 13778 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: loading cluster ID for follower catalog manager: success
I20260811 16:58:01.360651 14267 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:01.484443 14257 tablet_bootstrap.cc:700] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: Time spent opening tablet: real 0.134s user 0.002s sys 0.000s
I20260811 16:58:01.537674 14257 tablet_bootstrap.cc:654] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.587177 13778 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: acquiring CA information for follower catalog manager: success
I20260811 16:58:01.596055 13782 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: acquiring CA information for follower catalog manager: success
W20260811 16:58:01.606441 13946 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.149.67:35599, user_credentials={real_user=slave}} blocked reactor thread for 108570us
I20260811 16:58:01.612993 14252 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: No bootstrap required, opened a new log
I20260811 16:58:01.613607 14252 ts_tablet_manager.cc:1397] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent bootstrapping tablet: real 0.410s user 0.021s sys 0.014s
I20260811 16:58:01.616745 14252 raft_consensus.cc:348] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.620440 14252 raft_consensus.cc:374] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.620776 14252 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.621519 14252 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.625895 13782 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:58:01.653316 14286 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:01.654440 14254 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: No bootstrap required, opened a new log
I20260811 16:58:01.655220 14254 ts_tablet_manager.cc:1397] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Time spent bootstrapping tablet: real 0.457s user 0.010s sys 0.007s
I20260811 16:58:01.654400 14286 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:01.661980 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
W20260811 16:58:01.644977 13410 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.149.125:37675, user_credentials={real_user=slave}} blocked reactor thread for 45638.3us
I20260811 16:58:01.688382 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:01.682708 14286 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:01.691547 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e320a31507574e6690347aa60ee9dd01; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07
I20260811 16:58:01.692349 14286 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:58:01.697547 13826 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.149.67:35599, user_credentials={real_user=slave}} blocked reactor thread for 54390.5us
I20260811 16:58:01.698647 14283 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:01.699486 13778 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:58:01.700050 14252 ts_tablet_manager.cc:1428] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent starting tablet: real 0.086s user 0.008s sys 0.000s
I20260811 16:58:01.699409 14283 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
W20260811 16:58:01.700526 14086 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.149.65:34679, user_credentials={real_user=slave}} blocked reactor thread for 109664us
I20260811 16:58:01.707209 14262 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.707918 14262 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.709900 14262 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.703828 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:01.713017 13883 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 0.
I20260811 16:58:01.722215 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:01.699486 14254 raft_consensus.cc:348] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.723816 14254 raft_consensus.cc:374] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.723114 14157 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 0.
I20260811 16:58:01.722133 14252 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: Bootstrap starting.
I20260811 16:58:01.724191 14254 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.726383 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:01.729159 14283 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:01.731002 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:01.731498 13556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:01.731659 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:01.719481 13944 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:01.736112 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:01.737022 13617 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed5c1ce9a8dc42fdbd2e074116464c07; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, e320a31507574e6690347aa60ee9dd01
I20260811 16:58:01.731050 14254 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.736080 14012 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 0.
I20260811 16:58:01.745499 14264 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:01.745971 14264 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:01.746340 14264 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.736937 13826 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:01.753198 14262 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:01.753221 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:01.753665 14254 ts_tablet_manager.cc:1428] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Time spent starting tablet: real 0.098s user 0.009s sys 0.001s
I20260811 16:58:01.753749 14262 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:01.754259 14262 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.754110 14153 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 0.
I20260811 16:58:01.750615 14283 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:01.758400 14254 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: Bootstrap starting.
W20260811 16:58:01.766686 13828 leader_election.cc:341] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:58:01.768347 13826 leader_election.cc:341] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:58:01.770644 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:01.773387 13826 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:01.775621 14257 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: No bootstrap required, opened a new log
I20260811 16:58:01.776489 14257 ts_tablet_manager.cc:1397] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: Time spent bootstrapping tablet: real 0.500s user 0.019s sys 0.042s
I20260811 16:58:01.780192 14262 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.782413 14254 tablet_bootstrap.cc:654] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.782119 14257 raft_consensus.cc:348] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.782912 14262 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:01.778762 14264 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.783931 14262 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:58:01.783250 14257 raft_consensus.cc:374] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.784813 14257 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.786156 14012 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76919c05073a4939984a36038b72c2a4 in current term 1: Already voted for candidate 2505f2b1878341cabe053fde06071180 in this term.
I20260811 16:58:01.787181 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:01.789330 14257 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.789827 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:01.787854 14153 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.790783 14010 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in current term 1: Already voted for candidate 2505f2b1878341cabe053fde06071180 in this term.
I20260811 16:58:01.791553 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:01.796540 14257 ts_tablet_manager.cc:1428] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: Time spent starting tablet: real 0.020s user 0.005s sys 0.005s
I20260811 16:58:01.798460 14257 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: Bootstrap starting.
I20260811 16:58:01.804316 14264 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:01.803829 14153 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 1.
I20260811 16:58:01.808131 13826 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:01.808674 14257 tablet_bootstrap.cc:654] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.810329 14252 tablet_bootstrap.cc:654] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:01.808650 13881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:01.811390 13881 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2505f2b1878341cabe053fde06071180 in current term 1: Already voted for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in this term.
I20260811 16:58:01.813045 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:01.814214 13883 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76919c05073a4939984a36038b72c2a4 in current term 1: Already voted for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in this term.
I20260811 16:58:01.814991 13944 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:01.815672 14297 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:01.816546 14297 raft_consensus.cc:686] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Becoming Leader. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:01.817162 14264 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:58:01.819612 14297 consensus_queue.cc:237] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:01.825258 14086 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:01.826390 14267 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:58:01.830886 14264 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.831395 14264 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.834679 14264 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.834803 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:01.835924 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
W20260811 16:58:01.836964 13944 leader_election.cc:341] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:58:01.837477 13946 leader_election.cc:341] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:58:01.837919 13946 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:01.838759 14264 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:58:01.839486 13436 catalog_manager.cc:5495] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65). New cstate: current_term: 1 leader_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:01.846949 14254 tablet_bootstrap.cc:492] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: No bootstrap required, opened a new log
I20260811 16:58:01.847833 14254 ts_tablet_manager.cc:1397] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.022s
I20260811 16:58:01.848119 14252 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: No bootstrap required, opened a new log
I20260811 16:58:01.848675 14252 ts_tablet_manager.cc:1397] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent bootstrapping tablet: real 0.129s user 0.015s sys 0.007s
I20260811 16:58:01.851259 14254 raft_consensus.cc:348] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.851627 14252 raft_consensus.cc:348] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.852118 14254 raft_consensus.cc:374] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.852357 14252 raft_consensus.cc:374] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.852483 14254 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.852622 14252 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.853515 14252 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.853991 14254 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.854676 14257 tablet_bootstrap.cc:492] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: No bootstrap required, opened a new log
I20260811 16:58:01.855237 14257 ts_tablet_manager.cc:1397] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: Time spent bootstrapping tablet: real 0.057s user 0.013s sys 0.006s
I20260811 16:58:01.858292 14257 raft_consensus.cc:348] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.859156 14257 raft_consensus.cc:374] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:01.859448 14257 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Initialized, Role: FOLLOWER
I20260811 16:58:01.860795 14257 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.862020 14252 ts_tablet_manager.cc:1428] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: Time spent starting tablet: real 0.013s user 0.004s sys 0.003s
I20260811 16:58:01.863547 14254 ts_tablet_manager.cc:1428] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: Time spent starting tablet: real 0.015s user 0.003s sys 0.003s
I20260811 16:58:01.867646 14257 ts_tablet_manager.cc:1428] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260811 16:58:01.877707 14264 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.878448 14264 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.880514 14264 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.882210 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:01.882908 14153 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 0.
I20260811 16:58:01.884050 13946 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:01.885511 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:01.886209 13883 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 0.
I20260811 16:58:01.888936 14264 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:01.889375 14264 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:01.889724 14264 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.895591 14297 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:01.896660 14264 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.896159 14297 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.902652 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:01.903332 14153 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.903525 14297 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.905699 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:01.906541 13883 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.905567 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:01.909878 14157 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 0.
I20260811 16:58:01.910971 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:01.912173 14010 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 0.
I20260811 16:58:01.911325 13826 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:01.914651 14297 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:01.915076 14297 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:01.915403 14297 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.916384 14153 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 1.
I20260811 16:58:01.918540 13946 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:01.928678 13883 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 1.
I20260811 16:58:01.929915 14297 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.931244 14264 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 1 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.932091 14264 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:01.932798 14264 raft_consensus.cc:686] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:01.934316 14264 consensus_queue.cc:237] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:01.943769 14262 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:01.945832 14297 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:01.950994 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:01.951721 14157 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.953311 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:01.954018 14010 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:01.960650 14157 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 1.
I20260811 16:58:01.962356 14297 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:01.971697 13435 catalog_manager.cc:5495] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 1 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:01.960880 14010 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 1.
I20260811 16:58:01.984390 13828 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:01.986445 14297 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:02.026185 14297 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Becoming Leader. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:02.027837 14297 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.048352 14315 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:02.066888 14315 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:58:02.122807 13435 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65). New cstate: current_term: 1 leader_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:02.143659 14297 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:58:02.165520 14297 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:02.360952 14339 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:02.361606 14339 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.365109 14339 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:02.386277 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:02.416834 14341 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:02.417906 14341 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.420428 14341 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:02.421365 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:02.425801 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:02.426553 13666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e320a31507574e6690347aa60ee9dd01 in term 1.
I20260811 16:58:02.427525 13556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:02.427953 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e320a31507574e6690347aa60ee9dd01, ed5c1ce9a8dc42fdbd2e074116464c07; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6
I20260811 16:58:02.428421 13556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5c1ce9a8dc42fdbd2e074116464c07 in term 1.
I20260811 16:58:02.429029 14339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:02.429440 14339 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:02.429873 14339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.434345 13618 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e320a31507574e6690347aa60ee9dd01, ed5c1ce9a8dc42fdbd2e074116464c07; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6
I20260811 16:58:02.435348 14341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:02.435796 14341 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:02.436142 14341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.437765 14339 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.439894 13557 raft_consensus.cc:1226] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 2 FOLLOWER]: Rejecting Update request from peer aadbf3c4b9d7495dbb76c1e2aebc2ab6 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:02.443743 14339 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 election: Requested vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:02.444463 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6"
I20260811 16:58:02.444213 14341 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.446504 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07"
I20260811 16:58:02.447942 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6"
I20260811 16:58:02.448266 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e320a31507574e6690347aa60ee9dd01; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07
I20260811 16:58:02.449832 14339 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.451327 14341 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 election: Requested vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:02.451994 13556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01"
I20260811 16:58:02.453568 13618 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed5c1ce9a8dc42fdbd2e074116464c07; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, e320a31507574e6690347aa60ee9dd01
I20260811 16:58:02.454707 14341 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.460021 13666 raft_consensus.cc:1226] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 2 FOLLOWER]: Rejecting Update request from peer aadbf3c4b9d7495dbb76c1e2aebc2ab6 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:02.461951 14330 consensus_queue.cc:1046] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 }, Status: INVALID_TERM, Last received: 1.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:58:02.463203 14330 raft_consensus.cc:3032] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:58:02.463696 14330 raft_consensus.cc:729] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aadbf3c4b9d7495dbb76c1e2aebc2ab6, State: Running, Role: LEADER
I20260811 16:58:02.464635 14330 consensus_queue.cc:260] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.465318 14267 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:02.465932 14330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.467142 14267 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.476454 14342 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:02.477278 14267 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:02.478875 14297 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:02.479573 14297 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.482188 14297 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:02.477224 14342 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:02.484527 14342 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:02.487820 14342 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:02.488512 14342 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.491065 14342 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:02.507180 13881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:02.507418 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:02.508344 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:02.508416 13880 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 1.
I20260811 16:58:02.511456 14086 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:02.513155 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:02.513819 14315 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:02.514338 14315 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.516759 14315 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:02.523607 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:02.527102 14342 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:02.527611 14342 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:02.525472 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
W20260811 16:58:02.521093 14219 master_proxy_rpc.cc:203] Re-attempting GetTableSchema request to leader Master (127.10.149.126:42349)
I20260811 16:58:02.530304 13946 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:02.532095 14315 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.528158 14342 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.534241 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.535943 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.538091 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.542107 14342 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.543360 14089 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:02.544561 14342 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:02.544682 14267 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.546289 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.546449 14089 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:02.547264 14267 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.547946 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:02.549297 14297 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.552734 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:02.555095 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:02.557003 14086 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:02.557956 14267 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:58:02.595144 14157 raft_consensus.cc:1226] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:02.598030 14315 consensus_queue.cc:1046] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:58:02.599228 14323 raft_consensus.cc:3032] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:58:02.599570 14323 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:02.600416 14323 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.601737 14323 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.676559 14294 raft_consensus.cc:482] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:02.677139 14294 raft_consensus.cc:504] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.678936 14294 leader_election.cc:288] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:02.679795 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:02.680356 13557 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 2.
I20260811 16:58:02.680330 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:02.681123 13666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 2.
I20260811 16:58:02.681597 13410 leader_election.cc:302] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, e320a31507574e6690347aa60ee9dd01; no voters:
I20260811 16:58:02.682335 14294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:58:02.682739 14294 raft_consensus.cc:482] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:02.683104 14294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.688792 14294 raft_consensus.cc:504] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.691598 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01"
I20260811 16:58:02.691916 14294 leader_election.cc:288] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 3 election: Requested vote from peers e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:02.692234 13557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.694710 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07"
I20260811 16:58:02.695338 13666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.700160 13557 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 3.
I20260811 16:58:02.701881 13666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aadbf3c4b9d7495dbb76c1e2aebc2ab6 in term 3.
I20260811 16:58:02.702263 13410 leader_election.cc:302] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, e320a31507574e6690347aa60ee9dd01; no voters:
I20260811 16:58:02.703995 14294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:58:02.704454 14294 raft_consensus.cc:686] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 LEADER]: Becoming Leader. State: Replica: aadbf3c4b9d7495dbb76c1e2aebc2ab6, State: Running, Role: LEADER
I20260811 16:58:02.705363 14294 consensus_queue.cc:237] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:02.709514 14330 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.710101 14330 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:02.711715 14344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:02.721589 14344 catalog_manager.cc:669] Loaded metadata for table test-table [id=974e15145d3b497db94849e0e4244426]
I20260811 16:58:02.728590 14344 tablet_loader.cc:96] loaded metadata for tablet 4789cbc55f324255b7e296755cd69dca (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:02.730199 14344 tablet_loader.cc:96] loaded metadata for tablet 56b0537688054a8a98470218be6f413e (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:02.731498 14344 tablet_loader.cc:96] loaded metadata for tablet c670d49aabef48b1b1aa3a3c355b7558 (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:02.733279 14344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:02.736909 14344 catalog_manager.cc:1259] Loaded cluster ID: 9652a7237cae44988a70481d76d72f21
I20260811 16:58:02.737252 14344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:02.741324 14344 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:02.744714 14344 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: Loaded TSK: 0
I20260811 16:58:02.746212 14344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:02.780279 13918 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:02.787998 13557 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Refusing update from remote peer aadbf3c4b9d7495dbb76c1e2aebc2ab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260811 16:58:02.795990 14262 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:02.796595 14262 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.798802 14262 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:02.800894 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.801617 14009 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 2.
I20260811 16:58:02.803107 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:02.803454 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:02.804152 14262 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:02.804370 14157 raft_consensus.cc:2379] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in current term 2: Already voted for candidate 76919c05073a4939984a36038b72c2a4 in this term.
I20260811 16:58:02.804689 14262 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:02.806054 14262 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:02.807698 14267 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:02.808212 14267 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.812160 14267 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:02.812546 13666 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Refusing update from remote peer aadbf3c4b9d7495dbb76c1e2aebc2ab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260811 16:58:02.814746 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:02.816510 14262 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.817901 13880 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 2.
I20260811 16:58:02.818828 14262 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:02.819669 14086 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:02.815580 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:02.820298 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:02.820604 14009 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 2.
I20260811 16:58:02.820664 14330 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:58:02.821180 14267 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:58:02.822201 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:02.822731 14267 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:02.823256 14267 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.825124 14341 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.826045 14341 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:02.836584 14330 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.837560 14330 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:02.838225 14341 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.839110 14341 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:02.835261 14267 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.842846 14157 raft_consensus.cc:2354] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 2. Current term is 3.
I20260811 16:58:02.846132 13826 leader_election.cc:398] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 election: Vote denied by peer 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599) with higher term. Message: Invalid argument: T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 2. Current term is 3.
I20260811 16:58:02.846585 13826 leader_election.cc:401] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260811 16:58:02.847678 14262 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.858021 14262 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599) with higher term. Message: Invalid argument: T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 2. Current term is 3.
I20260811 16:58:02.860080 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:02.862916 14267 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:02.863943 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:02.864642 14009 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:02.869551 13880 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 3.
I20260811 16:58:02.871093 14086 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:02.872113 14267 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:58:02.873869 14210 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:02.880474 14267 raft_consensus.cc:686] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Becoming Leader. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:02.881609 14267 consensus_queue.cc:237] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:02.884579 14009 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 3.
I20260811 16:58:02.885445 14064 heartbeater.cc:503] Master 127.10.149.126:42349 was elected leader, sending a full tablet report...
I20260811 16:58:02.907120 13437 catalog_manager.cc:5495] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 1 to 3, leader changed from 2505f2b1878341cabe053fde06071180 (127.10.149.66) to 76919c05073a4939984a36038b72c2a4 (127.10.149.67). New cstate: current_term: 3 leader_uuid: "76919c05073a4939984a36038b72c2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:02.912925 14294 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:58:02.949466 14362 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.950621 14362 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:02.950508 14339 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aadbf3c4b9d7495dbb76c1e2aebc2ab6. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.951393 14339 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:02.952872 13799 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:02.953765 13799 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:02.995411 14009 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:58:02.996843 14267 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:58:03.011654 13880 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:58:03.013736 14342 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:58:03.163786 13970 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58062: Illegal state: replica 2505f2b1878341cabe053fde06071180 is not leader of this config: current role FOLLOWER
W20260811 16:58:03.171264 13848 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34916: Illegal state: replica 664a5f3a6eb845d68f1f99e5f9cdab18 is not leader of this config: current role FOLLOWER
W20260811 16:58:03.343117 13585 debug-util.cc:398] Leaking SignalData structure 0x7b080019c740 after lost signal to thread 10843
W20260811 16:58:03.344615 13585 debug-util.cc:398] Leaking SignalData structure 0x7b0800164480 after lost signal to thread 13498
W20260811 16:58:03.345933 13585 debug-util.cc:398] Leaking SignalData structure 0x7b080019cf40 after lost signal to thread 13593
W20260811 16:58:03.347023 13585 debug-util.cc:398] Leaking SignalData structure 0x7b080024b7e0 after lost signal to thread 13705
I20260811 16:58:06.183372 14421 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:06.184542 14421 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.187350 14421 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:06.194073 14422 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:06.194684 14422 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.199525 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:06.200361 14422 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:06.202886 14423 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:06.203464 14423 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.207168 14423 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:06.207495 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:06.209403 14421 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:06.210374 14421 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.211823 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:06.212503 14010 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 1.
I20260811 16:58:06.212488 14421 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:06.213850 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:06.214672 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:06.216882 14089 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:06.219312 14423 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:06.220336 14423 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:06.220793 14423 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:06.229774 14423 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.232846 14423 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:06.234997 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:06.236346 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:06.238087 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:06.238899 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:06.239856 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:06.240942 14297 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:06.241297 14089 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:06.241659 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:06.242197 14423 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:58:06.243754 13946 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:06.245572 14421 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:58:06.245091 13946 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:06.246804 14421 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:06.299031 14152 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:06.300781 14297 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:58:06.301751 14422 raft_consensus.cc:3032] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:58:06.302196 14422 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:06.303185 14422 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.304850 14422 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:06.481200 14421 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:06.482014 14421 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.484220 14421 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:06.485407 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:06.485407 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:06.486406 14152 raft_consensus.cc:2379] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2505f2b1878341cabe053fde06071180 in current term 2: Already voted for candidate 76919c05073a4939984a36038b72c2a4 in this term.
I20260811 16:58:06.486359 13880 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 2.
I20260811 16:58:06.488111 13944 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:06.489238 14421 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:06.489717 14421 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:06.490116 14421 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:06.498086 14421 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.501260 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:06.502043 14421 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:06.503731 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:06.504582 14152 raft_consensus.cc:2379] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2505f2b1878341cabe053fde06071180 in current term 2: Already voted for candidate 76919c05073a4939984a36038b72c2a4 in this term.
I20260811 16:58:06.509544 13883 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 2.
I20260811 16:58:06.510820 13944 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 76919c05073a4939984a36038b72c2a4
I20260811 16:58:06.511730 14421 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:58:06.515017 14421 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:06.517331 14421 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.531977 14423 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:06.532645 14423 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.536582 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:06.536937 14423 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:06.537312 13883 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 2.
I20260811 16:58:06.538484 14086 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:06.539599 14423 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:58:06.540025 14423 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:06.540122 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:06.540488 14423 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:06.533322 13430 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 reported cstate change: term changed from 1 to 2, leader changed from 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65) to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 2 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:06.547730 14423 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.550678 14423 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:06.551790 14009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:06.555051 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:06.555665 13883 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:06.563644 13883 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 3.
I20260811 16:58:06.565057 14086 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180
I20260811 16:58:06.568326 14423 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:58:06.568988 14423 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Becoming Leader. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:06.572010 14423 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.615321 13437 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 2 to 3, leader changed from 2505f2b1878341cabe053fde06071180 (127.10.149.66) to 76919c05073a4939984a36038b72c2a4 (127.10.149.67). New cstate: current_term: 3 leader_uuid: "76919c05073a4939984a36038b72c2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:06.623405 13883 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 2. Current term is 3. Ops: []
I20260811 16:58:06.624194 14152 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 2. Current term is 3. Ops: []
I20260811 16:58:06.625957 14428 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:06.649636 14421 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:58:06.650396 14421 consensus_queue.cc:1225] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer 76919c05073a4939984a36038b72c2a4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260811 16:58:06.653019 14428 raft_consensus.cc:3032] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:58:06.653343 14428 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:06.654078 14428 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:06.655082 14428 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:06.662681 13883 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:58:06.664551 14423 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:58:06.696385 14009 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260811 16:58:06.696820 14009 pending_rounds.cc:76] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Aborting all ops after (but not including) 2
I20260811 16:58:06.697073 14009 pending_rounds.cc:97] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260811 16:58:06.697424 14009 raft_consensus.cc:2866] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:58:06.700789 14416 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260811 16:58:07.117854 13493 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2b40 after lost signal to thread 10843
W20260811 16:58:07.118782 13493 debug-util.cc:398] Leaking SignalData structure 0x7b0800030160 after lost signal to thread 13498
W20260811 16:58:07.119632 13493 debug-util.cc:398] Leaking SignalData structure 0x7b08000f62a0 after lost signal to thread 13593
W20260811 16:58:07.120590 13493 debug-util.cc:398] Leaking SignalData structure 0x7b08002500a0 after lost signal to thread 13705
W20260811 16:58:07.121941 13493 debug-util.cc:398] Leaking SignalData structure 0x7b0800263580 after lost signal to thread 13914
W20260811 16:58:07.122833 13493 debug-util.cc:398] Leaking SignalData structure 0x7b0800266b60 after lost signal to thread 14054
W20260811 16:58:07.123762 13493 debug-util.cc:398] Leaking SignalData structure 0x7b08002644a0 after lost signal to thread 14203
I20260811 16:58:08.351161 14416 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:08.351854 14416 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:08.378788 14416 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:08.406148 14457 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:08.407183 14457 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:08.409668 14457 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:08.417515 14459 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:08.418262 14459 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:08.420754 14459 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
W20260811 16:58:08.579592 14086 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.149.65:34679 timed out after 0.200s (SENT) [suppressed 11 similar messages]
W20260811 16:58:09.447625 14198 debug-util.cc:398] Leaking SignalData structure 0x7b0800219060 after lost signal to thread 10843
I20260811 16:58:09.490810 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:09.491617 13881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:09.491652 14007 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 3.
I20260811 16:58:09.494462 13828 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:09.496273 14461 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:58:09.496754 14461 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:09.497217 14461 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:09.506093 14462 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:09.513705 14462 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:09.516827 14462 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:09.511190 14461 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:09.519790 13880 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 3. Current term is 4. Ops: []
I20260811 16:58:09.518371 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:09.518715 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:09.520787 14461 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:09.522662 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:09.523269 14007 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:09.525938 14002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:09.527062 14003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:09.520180 14466 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:09.530040 14466 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:09.531358 14002 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 1.
I20260811 16:58:09.533704 14466 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:09.534231 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:09.534950 14153 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 1.
I20260811 16:58:09.536229 13946 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:09.537705 14466 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:58:09.538167 14466 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:09.538537 14466 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:09.540040 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:09.546685 14466 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:09.549932 14466 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:09.549973 14007 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 4.
I20260811 16:58:09.551256 14012 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 3. Current term is 4. Ops: []
I20260811 16:58:09.552253 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:09.552867 14152 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:09.552798 13828 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:09.553923 14461 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Leader election won for term 4
W20260811 16:58:09.559480 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08002197c0 after lost signal to thread 13498
I20260811 16:58:09.569962 13883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:09.571182 14472 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:09.571817 14472 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:09.572072 13881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:09.578238 13876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:09.579200 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 13 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:09.581246 13944 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:09.582623 14466 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:09.583973 14472 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:09.585088 13876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
W20260811 16:58:09.586992 14198 debug-util.cc:398] Leaking SignalData structure 0x7b0800219e80 after lost signal to thread 13593
W20260811 16:58:09.595496 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08001fbac0 after lost signal to thread 13705
I20260811 16:58:09.599653 13664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 13 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:09.602996 14152 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 2.
I20260811 16:58:09.603942 14153 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:09.605381 14010 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:09.616080 14416 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:09.618783 13946 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:09.620116 14466 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:58:09.620667 14466 raft_consensus.cc:686] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:09.621624 14466 consensus_queue.cc:237] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:09.624176 14461 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Becoming Leader. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:09.625183 14467 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:09.626019 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:09.626399 14461 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
W20260811 16:58:09.628527 14198 debug-util.cc:398] Leaking SignalData structure 0x7b080024d9c0 after lost signal to thread 13914
I20260811 16:58:09.628842 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
W20260811 16:58:09.629814 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccea0 after lost signal to thread 14054
W20260811 16:58:09.631117 14198 debug-util.cc:398] Leaking SignalData structure 0x7b080022a920 after lost signal to thread 14203
W20260811 16:58:09.631420 14198 debug-util.cc:398] Leaking SignalData structure 0x7b080022a900 after lost signal to thread 14206
I20260811 16:58:09.632158 13944 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2505f2b1878341cabe053fde06071180; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:09.633369 14462 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:09.639235 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e320a31507574e6690347aa60ee9dd01; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07
I20260811 16:58:09.640563 14472 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:09.641279 14089 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:09.647269 14461 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:09.661886 13437 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 reported cstate change: term changed from 3 to 4, leader changed from 76919c05073a4939984a36038b72c2a4 (127.10.149.67) to 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65). New cstate: current_term: 4 leader_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } }
W20260811 16:58:09.672724 13826 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.149.67:35599, user_credentials={real_user=slave}} blocked reactor thread for 63232.1us
I20260811 16:58:09.672950 14483 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260811 16:58:09.670372 13828 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.149.66:32863, user_credentials={real_user=slave}} blocked reactor thread for 55983.9us
I20260811 16:58:09.681735 13430 catalog_manager.cc:5495] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 reported cstate change: term changed from 1 to 2, leader changed from 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65) to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 2 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:09.683086 14010 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 1. Current term is 2. Ops: []
I20260811 16:58:09.686077 14467 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:58:09.686923 14467 consensus_queue.cc:1225] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer 2505f2b1878341cabe053fde06071180 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260811 16:58:09.688292 14476 raft_consensus.cc:3032] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:58:09.688720 14476 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:09.689589 14476 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:09.690563 14476 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:09.693616 14480 raft_consensus.cc:2741] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260811 16:58:09.694762 13880 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 3. Current term is 4. Ops: []
I20260811 16:58:09.697620 14475 raft_consensus.cc:3032] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:58:09.701642 14475 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:09.705319 14475 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:09.707190 14475 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:09.716992 14010 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Refusing update from remote peer 664a5f3a6eb845d68f1f99e5f9cdab18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:58:09.719575 14473 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:09.736023 13880 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:58:09.739872 14466 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:09.747184 14151 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:58:09.749188 14466 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:58:09.749609 14151 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Refusing update from remote peer 664a5f3a6eb845d68f1f99e5f9cdab18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:58:09.751246 14475 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:58:14.142155 14536 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:14.143750 14536 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:14.147197 14536 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:14.148675 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:14.148665 13664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:14.152349 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e320a31507574e6690347aa60ee9dd01; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07
I20260811 16:58:14.153196 14536 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:24.180166 14586 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:24.181886 14586 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:24.187726 14588 raft_consensus.cc:482] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:24.188035 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:24.188551 14588 raft_consensus.cc:504] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:24.192693 14588 leader_election.cc:288] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), ed5c1ce9a8dc42fdbd2e074116464c07 (127.10.149.124:32857)
I20260811 16:58:24.193804 14586 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:24.194450 13666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" is_pre_election: true
I20260811 16:58:24.196810 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e320a31507574e6690347aa60ee9dd01" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:24.197314 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:24.198782 13519 leader_election.cc:302] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e320a31507574e6690347aa60ee9dd01; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, ed5c1ce9a8dc42fdbd2e074116464c07
I20260811 16:58:24.201021 13618 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed5c1ce9a8dc42fdbd2e074116464c07; no voters: aadbf3c4b9d7495dbb76c1e2aebc2ab6, e320a31507574e6690347aa60ee9dd01
I20260811 16:58:24.201807 14586 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:24.224793 14588 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:58:24.426405 14578 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:24.427800 14578 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.437980 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:24.438624 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:24.439369 14151 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 4.
I20260811 16:58:24.442564 13946 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:24.448832 14578 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:24.450484 14578 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:58:24.451327 14578 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:24.451923 14578 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.467901 14578 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.472203 14550 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:24.472923 14550 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.473835 14584 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:24.474630 14584 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.475603 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:24.477103 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:24.477874 14584 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:24.478183 14151 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.479171 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:24.479516 14584 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:24.480283 14584 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.484485 14584 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.486256 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.487250 14010 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 3.
I20260811 16:58:24.487932 14153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:24.488859 14578 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 5 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:24.489207 14153 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 2.
I20260811 16:58:24.492383 13826 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:24.493206 14151 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 5.
I20260811 16:58:24.493518 14584 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:58:24.494225 14584 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:24.494581 14152 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 4. Current term is 5. Ops: []
I20260811 16:58:24.495024 14584 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:24.496043 14550 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:24.497622 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:24.499431 13946 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:24.502079 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 76919c05073a4939984a36038b72c2a4
I20260811 16:58:24.502810 14594 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:58:24.503429 14594 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:24.506201 14594 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.508332 14582 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:58:24.509121 14582 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:24.518211 14582 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:24.525894 14584 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.527902 13879 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76919c05073a4939984a36038b72c2a4 in current term 3: Already voted for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in this term.
I20260811 16:58:24.528662 14002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.534343 14584 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 3 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.546844 14582 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.548600 13879 raft_consensus.cc:1226] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 3. Current term is 4. Ops: []
I20260811 16:58:24.551564 14582 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:24.552552 14550 consensus_queue.cc:1046] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:24.552979 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:24.553967 14550 raft_consensus.cc:3032] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:58:24.554307 14550 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:24.555289 14550 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.556522 14550 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:24.563019 14002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:24.565753 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:24.570315 14002 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 LEADER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 4. Current term is 5. Ops: []
I20260811 16:58:24.575201 13828 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:24.575443 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.578490 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:24.579931 14089 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:24.581732 14584 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:58:24.581851 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:24.582453 14584 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:24.583104 14582 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:58:24.583684 13879 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 2. Current term is 3. Ops: []
I20260811 16:58:24.583814 14584 consensus_queue.cc:1225] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer 2505f2b1878341cabe053fde06071180 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:58:24.584944 14550 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:24.584916 14582 raft_consensus.cc:3032] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:58:24.590459 14582 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:24.589265 14594 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:24.601150 14550 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:58:24.596338 14582 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.599967 14594 raft_consensus.cc:3032] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:58:24.606909 14594 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:24.608871 14582 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.610720 14594 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.612285 14152 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:58:24.611505 13437 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 reported cstate change: term changed from 4 to 5, leader changed from 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65) to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 5 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:24.616377 14603 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260811 16:58:24.622990 13618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.149.125:37675, user_credentials={real_user=slave}} blocked reactor thread for 422100us
I20260811 16:58:24.627735 14157 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 2. Current term is 3. Ops: []
I20260811 16:58:24.628620 14594 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:58:24.652705 13879 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:58:24.654865 14603 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:24.771241 14550 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:24.771817 14550 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.774238 14550 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.777426 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.778518 14012 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 3.
I20260811 16:58:24.780551 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:24.781319 13879 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 4.
I20260811 16:58:24.783645 14086 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:24.784644 14550 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:58:24.785181 14550 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:24.785658 14550 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.796021 14550 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.797907 14550 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.802156 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:24.803227 14012 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.809907 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:24.812616 13879 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.823593 14012 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 5.
I20260811 16:58:24.824072 13879 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 5.
I20260811 16:58:24.824996 14582 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:24.826442 14089 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:24.825814 14582 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.827219 14550 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:58:24.827808 14550 raft_consensus.cc:686] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Becoming Leader. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:24.828593 14550 consensus_queue.cc:237] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:24.829982 14582 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.831154 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:24.832346 14152 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 3.
I20260811 16:58:24.836182 14595 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:24.836511 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.837152 14595 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.838128 14012 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 3.
I20260811 16:58:24.840201 13828 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:24.844056 14582 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:58:24.844805 14582 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:24.845799 14582 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:24.852660 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:24.855327 14595 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:24.859932 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:24.859722 14582 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.861740 14012 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 3.
I20260811 16:58:24.864027 14089 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:24.864223 14582 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:24.865577 13880 raft_consensus.cc:2379] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76919c05073a4939984a36038b72c2a4 in current term 4: Already voted for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in this term.
I20260811 16:58:24.866417 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:24.867368 14012 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:24.868531 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:24.865382 14595 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:58:24.873641 14152 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:24.885458 13430 catalog_manager.cc:5495] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "76919c05073a4939984a36038b72c2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:24.920935 14002 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:58:24.923825 13880 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:58:24.927070 14012 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 4.
I20260811 16:58:24.934098 14152 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 4.
I20260811 16:58:24.934764 14595 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:24.935312 14595 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.942936 13828 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:24.943966 14582 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:58:24.944869 14582 raft_consensus.cc:686] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Becoming Leader. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:24.946933 14582 consensus_queue.cc:237] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.949540 14595 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:24.955982 14595 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:24.957094 14633 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:24.958520 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:24.959162 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:24.959607 14012 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:24.961625 14550 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:58:24.978004 14012 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76919c05073a4939984a36038b72c2a4 in term 5.
I20260811 16:58:24.997401 14089 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:24.998901 14550 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:58:25.000017 14550 raft_consensus.cc:686] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Becoming Leader. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:25.001369 14550 consensus_queue.cc:237] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:25.031620 13430 catalog_manager.cc:5495] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 reported cstate change: term changed from 2 to 4, leader changed from 2505f2b1878341cabe053fde06071180 (127.10.149.66) to 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65). New cstate: current_term: 4 leader_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:25.066370 14152 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 4. Current term is 5. Ops: []
I20260811 16:58:25.073207 14596 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260811 16:58:25.074770 14596 consensus_queue.cc:1225] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Peer 76919c05073a4939984a36038b72c2a4 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:58:25.075803 14584 raft_consensus.cc:3032] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:58:25.076402 14584 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:25.078192 14002 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Rejecting Update request from peer 664a5f3a6eb845d68f1f99e5f9cdab18 for earlier term 4. Current term is 5. Ops: []
I20260811 16:58:25.077783 14584 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:25.081131 13437 catalog_manager.cc:5495] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 4 to 5, leader changed from 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65) to 76919c05073a4939984a36038b72c2a4 (127.10.149.67). New cstate: current_term: 5 leader_uuid: "76919c05073a4939984a36038b72c2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:25.083761 14582 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:25.087503 14584 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:58:25.111477 13880 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260811 16:58:25.111940 13880 pending_rounds.cc:76] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Aborting all ops after (but not including) 3
I20260811 16:58:25.112221 13880 pending_rounds.cc:97] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260811 16:58:25.112607 13880 raft_consensus.cc:2866] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:58:25.114490 14633 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:25.121568 14002 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Refusing update from remote peer 76919c05073a4939984a36038b72c2a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:58:25.123342 14550 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260811 16:58:25.221905 13585 debug-util.cc:398] Leaking SignalData structure 0x7b08000d17c0 after lost signal to thread 10843
W20260811 16:58:25.223057 13585 debug-util.cc:398] Leaking SignalData structure 0x7b0800226ae0 after lost signal to thread 13498
W20260811 16:58:25.223958 13585 debug-util.cc:398] Leaking SignalData structure 0x7b0800226300 after lost signal to thread 13593
W20260811 16:58:25.224792 13585 debug-util.cc:398] Leaking SignalData structure 0x7b080019cd80 after lost signal to thread 13705
W20260811 16:58:25.226038 13585 debug-util.cc:398] Leaking SignalData structure 0x7b0800261380 after lost signal to thread 13914
W20260811 16:58:25.226905 13585 debug-util.cc:398] Leaking SignalData structure 0x7b080010a140 after lost signal to thread 14054
W20260811 16:58:25.227811 13585 debug-util.cc:398] Leaking SignalData structure 0x7b0800255c60 after lost signal to thread 14203
I20260811 16:58:28.069393 14655 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:28.070003 14655 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:28.073829 14655 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:28.082080 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01" is_pre_election: true
I20260811 16:58:28.083365 13557 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5c1ce9a8dc42fdbd2e074116464c07 in term 3.
I20260811 16:58:28.085034 13618 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e320a31507574e6690347aa60ee9dd01, ed5c1ce9a8dc42fdbd2e074116464c07; no voters:
I20260811 16:58:28.086691 14655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:58:28.087287 14655 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aadbf3c4b9d7495dbb76c1e2aebc2ab6)
I20260811 16:58:28.088013 14655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:28.104355 14655 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:28.108929 14655 leader_election.cc:288] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 election: Requested vote from peers aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349), e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675)
I20260811 16:58:28.112052 13557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "e320a31507574e6690347aa60ee9dd01"
I20260811 16:58:28.113111 13557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:28.126001 14658 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.127526 14658 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.138082 13557 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5c1ce9a8dc42fdbd2e074116464c07 in term 4.
I20260811 16:58:28.140669 14659 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.140656 14578 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.143551 14659 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.139128 14658 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:28.142338 13618 leader_election.cc:302] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e320a31507574e6690347aa60ee9dd01, ed5c1ce9a8dc42fdbd2e074116464c07; no voters:
I20260811 16:58:28.144290 14578 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.147926 14655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:58:28.158212 13557 raft_consensus.cc:1226] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 4 FOLLOWER]: Rejecting Update request from peer aadbf3c4b9d7495dbb76c1e2aebc2ab6 for earlier term 3. Current term is 4. Ops: []
I20260811 16:58:28.160203 14578 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:28.148943 14659 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.164597 14650 consensus_queue.cc:1046] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 }, Status: INVALID_TERM, Last received: 3.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:58:28.165462 14655 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 4 LEADER]: Becoming Leader. State: Replica: ed5c1ce9a8dc42fdbd2e074116464c07, State: Running, Role: LEADER
I20260811 16:58:28.166852 14650 raft_consensus.cc:3032] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:58:28.168115 14650 raft_consensus.cc:729] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aadbf3c4b9d7495dbb76c1e2aebc2ab6, State: Running, Role: LEADER
I20260811 16:58:28.167290 14655 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:28.171903 14658 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.173641 14658 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.174063 14650 consensus_queue.cc:260] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } }
I20260811 16:58:28.188578 14658 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.192055 13456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" is_pre_election: true
I20260811 16:58:28.192936 14658 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.195067 14658 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.190702 14650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:58:28.213600 14658 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.213819 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.214095 13455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6"
I20260811 16:58:28.234702 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.236016 14152 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 5.
I20260811 16:58:28.244731 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:28.245754 13879 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 5.
I20260811 16:58:28.248188 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:28.249702 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.249972 13879 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 5.
I20260811 16:58:28.251780 13944 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:28.253887 14659 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:58:28.254559 14659 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.255335 14659 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.259512 13826 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18, 76919c05073a4939984a36038b72c2a4; no voters:
I20260811 16:58:28.260990 14664 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:58:28.261816 14664 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.262089 13944 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:28.262835 14664 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.266356 13557 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 4 FOLLOWER]: Refusing update from remote peer ed5c1ce9a8dc42fdbd2e074116464c07: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 20. (index mismatch)
I20260811 16:58:28.270733 14655 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:58:28.273191 14667 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.274569 14667 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.275435 14659 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.281608 14012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.284950 13879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:28.286072 13879 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.289995 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.288672 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.294414 14659 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 election: Requested vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.295998 14659 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:58:28.296598 14659 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.296680 14002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.297479 14659 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.298416 14667 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:28.300117 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.306816 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:28.309461 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.311051 13879 raft_consensus.cc:2454] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 6.
I20260811 16:58:28.313802 13944 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters:
I20260811 16:58:28.315624 14578 raft_consensus.cc:2781] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:58:28.324220 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:28.328050 13828 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:28.275352 14661 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5c1ce9a8dc42fdbd2e074116464c07. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.329680 14661 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:28.327360 14659 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.331509 14007 raft_consensus.cc:1226] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 5. Current term is 6. Ops: []
I20260811 16:58:28.332202 13879 raft_consensus.cc:1226] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 5. Current term is 6. Ops: []
I20260811 16:58:28.329888 14658 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:58:28.335433 14659 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 election: Requested vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:28.333297 14086 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:28.337838 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18"
I20260811 16:58:28.339792 14633 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:58:28.341753 13456 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5c1ce9a8dc42fdbd2e074116464c07 in term 4.
I20260811 16:58:28.344659 14578 raft_consensus.cc:686] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:28.344659 14667 consensus_queue.cc:1046] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.346992 14667 raft_consensus.cc:3032] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:58:28.346164 14578 consensus_queue.cc:237] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.347936 14667 raft_consensus.cc:729] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:28.349653 14667 consensus_queue.cc:260] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.354750 14667 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.368443 13455 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 4 FOLLOWER]: Refusing update from remote peer ed5c1ce9a8dc42fdbd2e074116464c07: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 20. (index mismatch)
W20260811 16:58:28.372989 13456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38848 (request call id 5) took 186 ms (client timeout 205 ms). Trace:
W20260811 16:58:28.373859 13456 rpcz_store.cc:269] 0811 16:58:28.187236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 16:58:28.191023 (+ 3787us) service_pool.cc:227] Handling call
0811 16:58:28.367473 (+176450us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001b26d4. stack: 00007ff20d889033 00007ff20d888f30 00007ff20d1e7534 00000000003b4464 00000000003b43f9 00007ff2140ad471 00007ff21412c2ae 00007ff216335c27 00007ff213cbdc04 00007ff213cbdb92 00007ff213cbdac1 00007ff213cbda3c 00007ff213cbccf2 00007ff2123e994c 00007ff2123e8d86 00007ff2123e872f
0811 16:58:28.372834 (+ 5361us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":338122112}
I20260811 16:58:28.383095 14010 raft_consensus.cc:1226] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 LEADER]: Rejecting Update request from peer 76919c05073a4939984a36038b72c2a4 for earlier term 5. Current term is 6. Ops: []
I20260811 16:58:28.387305 14664 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
W20260811 16:58:28.388422 13946 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.149.67:35599, user_credentials={real_user=slave}} blocked reactor thread for 62457.2us
I20260811 16:58:28.388759 13879 raft_consensus.cc:1226] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Rejecting Update request from peer 2505f2b1878341cabe053fde06071180 for earlier term 5. Current term is 6. Ops: []
I20260811 16:58:28.388513 14655 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:58:28.392516 13828 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:28.388478 14595 consensus_queue.cc:1046] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.393051 14659 consensus_queue.cc:1046] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:58:28.394742 14658 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:58:28.395182 14578 raft_consensus.cc:3032] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:58:28.395928 14578 raft_consensus.cc:729] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:28.396795 14595 consensus_queue.cc:1225] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer 2505f2b1878341cabe053fde06071180 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:58:28.397228 14578 consensus_queue.cc:260] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.399886 14595 raft_consensus.cc:3032] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:58:28.400683 14595 raft_consensus.cc:729] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 76919c05073a4939984a36038b72c2a4, State: Running, Role: LEADER
I20260811 16:58:28.401077 14578 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.403846 14650 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5c1ce9a8dc42fdbd2e074116464c07. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.405381 14650 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:28.406224 14667 consensus_queue.cc:1046] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.408453 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "2505f2b1878341cabe053fde06071180" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:28.412271 14595 consensus_queue.cc:260] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.421988 14595 raft_consensus.cc:3037] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.424117 14151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4"
I20260811 16:58:28.428344 14664 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 election: Requested vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.438789 14668 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5c1ce9a8dc42fdbd2e074116464c07. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.445889 14668 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:28.444891 13879 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:58:28.450066 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180"
I20260811 16:58:28.449759 14578 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.465649 14157 raft_consensus.cc:2454] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2505f2b1878341cabe053fde06071180 in term 6.
I20260811 16:58:28.468092 13946 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4; no voters: 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:28.469663 14578 raft_consensus.cc:2781] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:58:28.470482 14578 raft_consensus.cc:686] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 LEADER]: Becoming Leader. State: Replica: 2505f2b1878341cabe053fde06071180, State: Running, Role: LEADER
I20260811 16:58:28.473898 14578 consensus_queue.cc:237] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.488070 14668 sys_catalog.cc:455] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.491310 14668 sys_catalog.cc:458] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:28.497835 14650 sys_catalog.cc:455] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.499905 14650 sys_catalog.cc:458] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:58:28.509717 14655 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.511960 14655 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:28.513583 14151 raft_consensus.cc:1261] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:58:28.524760 14010 raft_consensus.cc:2454] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 664a5f3a6eb845d68f1f99e5f9cdab18 in term 6.
I20260811 16:58:28.526443 14659 consensus_queue.cc:1035] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.542580 13828 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 76919c05073a4939984a36038b72c2a4
I20260811 16:58:28.545650 14664 raft_consensus.cc:2781] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:58:28.546975 14664 raft_consensus.cc:686] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 LEADER]: Becoming Leader. State: Replica: 664a5f3a6eb845d68f1f99e5f9cdab18, State: Running, Role: LEADER
I20260811 16:58:28.548729 14664 consensus_queue.cc:237] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.558053 14682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:28.582643 14658 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 76919c05073a4939984a36038b72c2a4)
I20260811 16:58:28.587318 14157 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:58:28.577248 14687 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:28.586961 14658 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.591666 14687 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:28.594548 14674 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260811 16:58:28.600744 14157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.613703 14595 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.620388 14658 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:28.636528 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.615592 14595 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.643568 13828 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:28.690860 14157 raft_consensus.cc:3037] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.692508 14010 raft_consensus.cc:1261] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Refusing update from remote peer 664a5f3a6eb845d68f1f99e5f9cdab18: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260811 16:58:28.694409 14664 consensus_queue.cc:1035] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:58:28.675477 13734 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:58:28.679126 14658 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:58:28.706964 13880 raft_consensus.cc:3037] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:58:28.709688 14595 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:28.710916 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.721529 13880 raft_consensus.cc:1261] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Refusing update from remote peer 2505f2b1878341cabe053fde06071180: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:58:28.733075 14674 consensus_queue.cc:1035] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [LEADER]: Connected to new peer: Peer: permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:58:28.734375 14682 catalog_manager.cc:669] Loaded metadata for table test-table [id=974e15145d3b497db94849e0e4244426]
I20260811 16:58:28.743923 13876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4789cbc55f324255b7e296755cd69dca" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:28.755330 14086 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:28.757030 14595 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:58:28.767678 14682 tablet_loader.cc:96] loaded metadata for tablet 4789cbc55f324255b7e296755cd69dca (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:28.772555 14682 tablet_loader.cc:96] loaded metadata for tablet 56b0537688054a8a98470218be6f413e (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:28.776194 14682 tablet_loader.cc:96] loaded metadata for tablet c670d49aabef48b1b1aa3a3c355b7558 (table test-table [id=974e15145d3b497db94849e0e4244426])
I20260811 16:58:28.779667 14682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:28.795718 14682 catalog_manager.cc:1259] Loaded cluster ID: 9652a7237cae44988a70481d76d72f21
I20260811 16:58:28.796545 14682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:28.797582 14664 raft_consensus.cc:482] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.798702 14664 raft_consensus.cc:504] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:28.806388 14007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.816663 14682 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:28.828464 14682 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: Loaded TSK: 0
I20260811 16:58:28.832538 14682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:28.829783 14152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b0537688054a8a98470218be6f413e" candidate_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "76919c05073a4939984a36038b72c2a4" is_pre_election: true
I20260811 16:58:28.863376 14664 leader_election.cc:288] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 76919c05073a4939984a36038b72c2a4 (127.10.149.67:35599)
I20260811 16:58:28.865008 13826 leader_election.cc:302] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 664a5f3a6eb845d68f1f99e5f9cdab18; no voters: 2505f2b1878341cabe053fde06071180, 76919c05073a4939984a36038b72c2a4
I20260811 16:58:28.870241 14664 raft_consensus.cc:2726] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:58:28.874616 13641 catalog_manager.cc:5495] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 reported cstate change: term changed from 5 to 6, leader changed from 76919c05073a4939984a36038b72c2a4 (127.10.149.67) to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 6 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:28.880513 13643 catalog_manager.cc:5495] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 5 to 6, leader changed from 2505f2b1878341cabe053fde06071180 (127.10.149.66) to 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65). New cstate: current_term: 6 leader_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } }
I20260811 16:58:28.902554 14595 raft_consensus.cc:482] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2505f2b1878341cabe053fde06071180)
I20260811 16:58:28.903749 14595 raft_consensus.cc:504] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } }
I20260811 16:58:28.923213 14010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2505f2b1878341cabe053fde06071180" is_pre_election: true
I20260811 16:58:28.958292 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c670d49aabef48b1b1aa3a3c355b7558" candidate_uuid: "76919c05073a4939984a36038b72c2a4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" is_pre_election: true
I20260811 16:58:28.980832 14086 leader_election.cc:302] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:28.982636 14667 raft_consensus.cc:2726] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:58:28.925387 14595 leader_election.cc:288] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863), 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679)
I20260811 16:58:29.044680 14206 heartbeater.cc:503] Master 127.10.149.124:32857 was elected leader, sending a full tablet report...
I20260811 16:58:29.046579 13915 heartbeater.cc:503] Master 127.10.149.124:32857 was elected leader, sending a full tablet report...
I20260811 16:58:29.060544 13643 catalog_manager.cc:5495] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 reported cstate change: term changed from 5 to 6, leader changed from 76919c05073a4939984a36038b72c2a4 (127.10.149.67) to 2505f2b1878341cabe053fde06071180 (127.10.149.66). New cstate: current_term: 6 leader_uuid: "2505f2b1878341cabe053fde06071180" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } } }
I20260811 16:58:29.112807 14058 heartbeater.cc:503] Master 127.10.149.124:32857 was elected leader, sending a full tablet report...
W20260811 16:58:29.207543 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc740 after lost signal to thread 10843
W20260811 16:58:29.209268 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4e60 after lost signal to thread 13498
W20260811 16:58:29.211093 14198 debug-util.cc:398] Leaking SignalData structure 0x7b0800165bc0 after lost signal to thread 13593
W20260811 16:58:29.212551 14198 debug-util.cc:398] Leaking SignalData structure 0x7b080010d7c0 after lost signal to thread 13705
W20260811 16:58:29.214267 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6f00 after lost signal to thread 13914
W20260811 16:58:29.215629 14198 debug-util.cc:398] Leaking SignalData structure 0x7b080022b760 after lost signal to thread 14054
W20260811 16:58:29.216897 14198 debug-util.cc:398] Leaking SignalData structure 0x7b08001bca40 after lost signal to thread 14203
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:783: Failure
Expected equality of these values:
live_row_count
Which is: 802
table_info->GetMetrics()->live_row_count->value()
Which is: 0
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:767: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:785: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 782, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:822: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260811 16:58:34.044800 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
W20260811 16:58:34.066550 13944 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260811 16:58:34.071344 13944 consensus_peers.cc:487] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 -> Peer 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679): Couldn't send request to peer 664a5f3a6eb845d68f1f99e5f9cdab18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:34.090087 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:34.091079 10837 tablet_replica.cc:330] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18: stopping tablet replica
I20260811 16:58:34.091976 10837 raft_consensus.cc:2229] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 LEADER]: Raft consensus shutting down.
I20260811 16:58:34.092958 10837 raft_consensus.cc:2258] T 4789cbc55f324255b7e296755cd69dca P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.095744 10837 tablet_replica.cc:330] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18: stopping tablet replica
I20260811 16:58:34.096304 10837 raft_consensus.cc:2229] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.096771 10837 raft_consensus.cc:2258] T 56b0537688054a8a98470218be6f413e P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.099164 10837 tablet_replica.cc:330] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18: stopping tablet replica
I20260811 16:58:34.099668 10837 raft_consensus.cc:2229] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.100234 10837 raft_consensus.cc:2258] T c670d49aabef48b1b1aa3a3c355b7558 P 664a5f3a6eb845d68f1f99e5f9cdab18 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260811 16:58:34.104704 13944 consensus_peers.cc:487] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 -> Peer 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679): Couldn't send request to peer 664a5f3a6eb845d68f1f99e5f9cdab18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:34.128378 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:34.147409 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:58:34.225229 14735 raft_consensus.cc:482] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 664a5f3a6eb845d68f1f99e5f9cdab18)
I20260811 16:58:34.226980 14735 raft_consensus.cc:504] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "664a5f3a6eb845d68f1f99e5f9cdab18" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 34679 } } peers { permanent_uuid: "2505f2b1878341cabe053fde06071180" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 32863 } } peers { permanent_uuid: "76919c05073a4939984a36038b72c2a4" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 35599 } }
I20260811 16:58:34.231199 14735 leader_election.cc:288] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679), 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863)
I20260811 16:58:34.235837 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
W20260811 16:58:34.239939 14089 leader_election.cc:334] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2505f2b1878341cabe053fde06071180 (127.10.149.66:32863): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:58:34.240659 10837 tablet_replica.cc:330] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180: stopping tablet replica
I20260811 16:58:34.242098 10837 raft_consensus.cc:2229] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 LEADER]: Raft consensus shutting down.
W20260811 16:58:34.242252 14086 leader_election.cc:334] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 664a5f3a6eb845d68f1f99e5f9cdab18 (127.10.149.65:34679): Network error: Client connection negotiation failed: client connection to 127.10.149.65:34679: connect: Connection refused (error 111)
I20260811 16:58:34.242903 14086 leader_election.cc:302] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76919c05073a4939984a36038b72c2a4; no voters: 2505f2b1878341cabe053fde06071180, 664a5f3a6eb845d68f1f99e5f9cdab18
I20260811 16:58:34.244015 14735 raft_consensus.cc:2726] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:58:34.245074 10837 raft_consensus.cc:2258] T 56b0537688054a8a98470218be6f413e P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.249548 10837 tablet_replica.cc:330] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180: stopping tablet replica
I20260811 16:58:34.250074 10837 raft_consensus.cc:2229] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.250622 10837 raft_consensus.cc:2258] T 4789cbc55f324255b7e296755cd69dca P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.253094 10837 tablet_replica.cc:330] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180: stopping tablet replica
I20260811 16:58:34.253739 10837 raft_consensus.cc:2229] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 LEADER]: Raft consensus shutting down.
I20260811 16:58:34.254890 10837 raft_consensus.cc:2258] T c670d49aabef48b1b1aa3a3c355b7558 P 2505f2b1878341cabe053fde06071180 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.280509 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:58:34.300493 10837 tablet_server.cc:178] TabletServer@127.10.149.67:0 shutting down...
I20260811 16:58:34.342706 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:34.343515 10837 tablet_replica.cc:330] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4: stopping tablet replica
I20260811 16:58:34.344669 10837 raft_consensus.cc:2229] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.345479 10837 raft_consensus.cc:2258] T 4789cbc55f324255b7e296755cd69dca P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.348619 10837 tablet_replica.cc:330] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4: stopping tablet replica
I20260811 16:58:34.349242 10837 raft_consensus.cc:2229] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.349910 10837 raft_consensus.cc:2258] T 56b0537688054a8a98470218be6f413e P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.352509 10837 tablet_replica.cc:330] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4: stopping tablet replica
I20260811 16:58:34.353014 10837 raft_consensus.cc:2229] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.353543 10837 raft_consensus.cc:2258] T c670d49aabef48b1b1aa3a3c355b7558 P 76919c05073a4939984a36038b72c2a4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.408365 10837 tablet_server.cc:194] TabletServer@127.10.149.67:0 shutdown complete.
I20260811 16:58:34.428601 10837 master.cc:537] Master@127.10.149.126:42349 shutting down...
I20260811 16:58:34.466861 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.467826 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.468345 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P aadbf3c4b9d7495dbb76c1e2aebc2ab6: stopping tablet replica
W20260811 16:58:34.483961 13617 consensus_peers.cc:487] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 -> Peer aadbf3c4b9d7495dbb76c1e2aebc2ab6 (127.10.149.126:42349): Couldn't send request to peer aadbf3c4b9d7495dbb76c1e2aebc2ab6. Status: Network error: Client connection negotiation failed: client connection to 127.10.149.126:42349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:34.512825 10837 master.cc:552] Master@127.10.149.126:42349 shutdown complete.
I20260811 16:58:34.538163 10837 master.cc:537] Master@127.10.149.125:37675 shutting down...
W20260811 16:58:34.564893 13618 consensus_peers.cc:487] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 -> Peer e320a31507574e6690347aa60ee9dd01 (127.10.149.125:37675): Couldn't send request to peer e320a31507574e6690347aa60ee9dd01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:34.571019 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:34.571838 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.572278 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P e320a31507574e6690347aa60ee9dd01: stopping tablet replica
I20260811 16:58:34.625671 14726 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:34.626734 14726 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:34.642673 14744 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aadbf3c4b9d7495dbb76c1e2aebc2ab6" member_type: VOTER last_known_addr { host: "127.10.149.126" port: 42349 } } peers { permanent_uuid: "e320a31507574e6690347aa60ee9dd01" member_type: VOTER last_known_addr { host: "127.10.149.125" port: 37675 } } peers { permanent_uuid: "ed5c1ce9a8dc42fdbd2e074116464c07" member_type: VOTER last_known_addr { host: "127.10.149.124" port: 32857 } } }
I20260811 16:58:34.643970 14744 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:34.675915 10837 master.cc:552] Master@127.10.149.125:37675 shutdown complete.
I20260811 16:58:34.697230 10837 master.cc:537] Master@127.10.149.124:32857 shutting down...
I20260811 16:58:34.737094 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 4 LEADER]: Raft consensus shutting down.
I20260811 16:58:34.738215 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:34.738794 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P ed5c1ce9a8dc42fdbd2e074116464c07: stopping tablet replica
I20260811 16:58:34.756228 10837 master.cc:552] Master@127.10.149.124:32857 shutdown complete.
I20260811 16:58:34.790112 10837 test_util.cc:175] -----------------------------------------------
I20260811 16:58:34.790334 10837 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786467463543483-10837-0
[ FAILED ] TsTabletManagerITest.TestTableStats (35015 ms)
[ RUN ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260811 16:58:34.798177 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:35245
I20260811 16:58:34.799417 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:34.805888 14755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:34.807426 14757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:34.809659 14761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:34.813036 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:34.814307 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:34.814520 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:34.814630 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467514814621 us; error 0 us; skew 500 ppm
I20260811 16:58:34.815115 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:34.817888 10837 webserver.cc:460] Webserver started at http://127.10.149.126:33471/ using document root <none> and password file <none>
I20260811 16:58:34.818343 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:34.818495 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:34.818722 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:34.820232 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "df6c7a6f4d104749b30246c8147d56b5"
format_stamp: "Formatted at 2026-08-11 16:58:34 on dist-test-slave-j2vl"
I20260811 16:58:34.825037 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260811 16:58:34.828660 14774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:34.829761 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:34.830050 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "df6c7a6f4d104749b30246c8147d56b5"
format_stamp: "Formatted at 2026-08-11 16:58:34 on dist-test-slave-j2vl"
I20260811 16:58:34.830308 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:34.844431 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:34.845898 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:34.894044 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:35245
I20260811 16:58:34.894148 14874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:35245 every 8 connection(s)
I20260811 16:58:34.898777 14875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:34.910013 14875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: Bootstrap starting.
I20260811 16:58:34.914898 14875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:34.919812 14875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: No bootstrap required, opened a new log
I20260811 16:58:34.922158 14875 raft_consensus.cc:348] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER }
I20260811 16:58:34.922566 14875 raft_consensus.cc:374] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:34.922852 14875 raft_consensus.cc:729] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6c7a6f4d104749b30246c8147d56b5, State: Initialized, Role: FOLLOWER
I20260811 16:58:34.923553 14875 consensus_queue.cc:260] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER }
I20260811 16:58:34.924024 14875 raft_consensus.cc:388] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:34.924266 14875 raft_consensus.cc:482] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:34.924590 14875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:34.929150 14875 raft_consensus.cc:504] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER }
I20260811 16:58:34.929735 14875 leader_election.cc:302] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df6c7a6f4d104749b30246c8147d56b5; no voters:
I20260811 16:58:34.931171 14875 leader_election.cc:288] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:34.931663 14880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:34.933188 14880 raft_consensus.cc:686] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: df6c7a6f4d104749b30246c8147d56b5, State: Running, Role: LEADER
I20260811 16:58:34.934027 14880 consensus_queue.cc:237] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER }
I20260811 16:58:34.934648 14875 sys_catalog.cc:564] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:34.940518 14881 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df6c7a6f4d104749b30246c8147d56b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER } }
I20260811 16:58:34.940888 14883 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df6c7a6f4d104749b30246c8147d56b5. Latest consensus state: current_term: 1 leader_uuid: "df6c7a6f4d104749b30246c8147d56b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6c7a6f4d104749b30246c8147d56b5" member_type: VOTER } }
I20260811 16:58:34.941711 14883 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:34.941612 14881 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:34.945093 14893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:34.950487 14893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:34.955322 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:34.961229 14893 catalog_manager.cc:1347] Generated new cluster ID: da58b5e15ab2427bbe2f3fa7e177d1b2
I20260811 16:58:34.961627 14893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:34.980786 14893 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:34.982556 14893 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:34.997874 14893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: Generated new TSK 0
I20260811 16:58:34.998654 14893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:35.022627 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:35.029227 14911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:35.030710 14912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:35.031957 14914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:35.033607 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:35.035166 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:35.035432 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:35.035609 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467515035591 us; error 0 us; skew 500 ppm
I20260811 16:58:35.036304 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:35.039083 10837 webserver.cc:460] Webserver started at http://127.10.149.65:35561/ using document root <none> and password file <none>
I20260811 16:58:35.039626 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:35.039848 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:35.040200 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:35.041600 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "e73170c2fe0545f3954f5e5574e0c009"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.046532 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 16:58:35.050384 14922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.051297 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 16:58:35.051553 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "e73170c2fe0545f3954f5e5574e0c009"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.051805 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:35.068538 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:35.069939 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:35.071476 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:35.074023 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:35.074235 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.074501 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:35.074721 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.123485 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:43555
I20260811 16:58:35.123600 15041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:43555 every 8 connection(s)
I20260811 16:58:35.129083 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:35.138564 15047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:35.139639 15048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:35.147431 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:35.147819 15052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:35.149322 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:35.149706 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:35.149811 15042 heartbeater.cc:347] Connected to a master server at 127.10.149.126:35245
I20260811 16:58:35.149909 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467515149895 us; error 0 us; skew 500 ppm
I20260811 16:58:35.150352 15042 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:35.150750 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:35.151139 15042 heartbeater.cc:511] Master 127.10.149.126:35245 requested a full tablet report, sending...
I20260811 16:58:35.153736 10837 webserver.cc:460] Webserver started at http://127.10.149.66:42557/ using document root <none> and password file <none>
I20260811 16:58:35.153807 14803 ts_manager.cc:194] Registered new tserver with Master: e73170c2fe0545f3954f5e5574e0c009 (127.10.149.65:43555)
I20260811 16:58:35.154521 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:35.154831 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:35.155184 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:35.156862 14803 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52016
I20260811 16:58:35.156863 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "4994ae42db7b467681ec4e6054d7a2b7"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.162521 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 16:58:35.166026 15060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.167050 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 16:58:35.167479 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "4994ae42db7b467681ec4e6054d7a2b7"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.167835 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:35.187099 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:35.188706 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:35.190423 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:35.193002 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:35.193208 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.193651 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:35.193833 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.241977 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:46219
I20260811 16:58:35.242080 15170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:46219 every 8 connection(s)
I20260811 16:58:35.247259 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:35.255718 15174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:35.256971 15175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:35.260931 15180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:35.261792 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:35.262892 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:35.263159 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:35.263356 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467515263340 us; error 0 us; skew 500 ppm
I20260811 16:58:35.264034 15171 heartbeater.cc:347] Connected to a master server at 127.10.149.126:35245
I20260811 16:58:35.264110 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:35.264420 15171 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:35.265324 15171 heartbeater.cc:511] Master 127.10.149.126:35245 requested a full tablet report, sending...
I20260811 16:58:35.267457 10837 webserver.cc:460] Webserver started at http://127.10.149.67:45491/ using document root <none> and password file <none>
I20260811 16:58:35.267863 14803 ts_manager.cc:194] Registered new tserver with Master: 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219)
I20260811 16:58:35.268102 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:35.268411 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:35.268723 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:35.269935 14803 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49242
I20260811 16:58:35.270349 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root/instance:
uuid: "1c16b280d5644f5f97e958eda4bc6d71"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.275338 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 16:58:35.279276 15187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.280405 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:58:35.280701 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root
uuid: "1c16b280d5644f5f97e958eda4bc6d71"
format_stamp: "Formatted at 2026-08-11 16:58:35 on dist-test-slave-j2vl"
I20260811 16:58:35.280963 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:35.294869 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:35.296331 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:35.297933 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:35.300961 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:35.301156 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.301498 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:35.301637 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:35.353642 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.67:40625
I20260811 16:58:35.353737 15301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.67:40625 every 8 connection(s)
I20260811 16:58:35.371176 15303 heartbeater.cc:347] Connected to a master server at 127.10.149.126:35245
I20260811 16:58:35.371563 15303 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:35.372265 15303 heartbeater.cc:511] Master 127.10.149.126:35245 requested a full tablet report, sending...
I20260811 16:58:35.374344 14803 ts_manager.cc:194] Registered new tserver with Master: 1c16b280d5644f5f97e958eda4bc6d71 (127.10.149.67:40625)
I20260811 16:58:35.375161 10837 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018111524s
I20260811 16:58:35.376070 14803 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49252
I20260811 16:58:35.417829 14803 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260811 16:58:35.420010 14803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:58:35.483215 15114 tablet_service.cc:1467] Processing CreateTablet for tablet c729a56be0d14da99bad39b83084527d (DEFAULT_TABLE table=test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]), partition=
I20260811 16:58:35.484516 15114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c729a56be0d14da99bad39b83084527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:35.486310 14978 tablet_service.cc:1467] Processing CreateTablet for tablet c729a56be0d14da99bad39b83084527d (DEFAULT_TABLE table=test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]), partition=
I20260811 16:58:35.487509 14978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c729a56be0d14da99bad39b83084527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:35.489009 15245 tablet_service.cc:1467] Processing CreateTablet for tablet c729a56be0d14da99bad39b83084527d (DEFAULT_TABLE table=test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]), partition=
I20260811 16:58:35.490286 15245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c729a56be0d14da99bad39b83084527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:35.501870 15329 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Bootstrap starting.
I20260811 16:58:35.506716 15331 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Bootstrap starting.
I20260811 16:58:35.507071 15329 tablet_bootstrap.cc:654] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:35.512900 15329 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: No bootstrap required, opened a new log
I20260811 16:58:35.513583 15329 ts_tablet_manager.cc:1397] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260811 16:58:35.514493 15333 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Bootstrap starting.
I20260811 16:58:35.513638 15331 tablet_bootstrap.cc:654] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:35.516839 15329 raft_consensus.cc:348] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.517824 15329 raft_consensus.cc:374] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:35.518193 15329 raft_consensus.cc:729] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73170c2fe0545f3954f5e5574e0c009, State: Initialized, Role: FOLLOWER
I20260811 16:58:35.519003 15329 consensus_queue.cc:260] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.521601 15333 tablet_bootstrap.cc:654] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:35.522809 15042 heartbeater.cc:503] Master 127.10.149.126:35245 was elected leader, sending a full tablet report...
I20260811 16:58:35.523367 15329 ts_tablet_manager.cc:1428] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
W20260811 16:58:35.523689 15329 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260811 16:58:35.524037 15331 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: No bootstrap required, opened a new log
I20260811 16:58:35.524593 15331 ts_tablet_manager.cc:1397] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.007s
I20260811 16:58:35.527843 15333 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: No bootstrap required, opened a new log
I20260811 16:58:35.528345 15333 ts_tablet_manager.cc:1397] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260811 16:58:35.529196 15331 raft_consensus.cc:348] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.530040 15331 raft_consensus.cc:374] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:35.530336 15331 raft_consensus.cc:729] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4994ae42db7b467681ec4e6054d7a2b7, State: Initialized, Role: FOLLOWER
I20260811 16:58:35.531138 15333 raft_consensus.cc:348] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.531045 15331 consensus_queue.cc:260] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.531876 15333 raft_consensus.cc:374] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:35.532191 15333 raft_consensus.cc:729] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c16b280d5644f5f97e958eda4bc6d71, State: Initialized, Role: FOLLOWER
I20260811 16:58:35.533004 15333 consensus_queue.cc:260] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.533684 15171 heartbeater.cc:503] Master 127.10.149.126:35245 was elected leader, sending a full tablet report...
I20260811 16:58:35.534144 15331 ts_tablet_manager.cc:1428] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
W20260811 16:58:35.534523 15331 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260811 16:58:35.536101 15303 heartbeater.cc:503] Master 127.10.149.126:35245 was elected leader, sending a full tablet report...
I20260811 16:58:35.536388 15333 ts_tablet_manager.cc:1428] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260811 16:58:35.536649 15333 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260811 16:58:35.606886 15336 raft_consensus.cc:482] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:35.607414 15336 raft_consensus.cc:504] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
W20260811 16:58:35.607965 15306 tablet.cc:2369] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:58:35.609889 15336 leader_election.cc:288] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219), 1c16b280d5644f5f97e958eda4bc6d71 (127.10.149.67:40625)
I20260811 16:58:35.622640 15262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c729a56be0d14da99bad39b83084527d" candidate_uuid: "e73170c2fe0545f3954f5e5574e0c009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c16b280d5644f5f97e958eda4bc6d71" is_pre_election: true
I20260811 16:58:35.623795 15262 raft_consensus.cc:2454] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e73170c2fe0545f3954f5e5574e0c009 in term 0.
I20260811 16:58:35.624537 15132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c729a56be0d14da99bad39b83084527d" candidate_uuid: "e73170c2fe0545f3954f5e5574e0c009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4994ae42db7b467681ec4e6054d7a2b7" is_pre_election: true
I20260811 16:58:35.625468 14928 leader_election.cc:302] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c16b280d5644f5f97e958eda4bc6d71, e73170c2fe0545f3954f5e5574e0c009; no voters:
I20260811 16:58:35.625510 15132 raft_consensus.cc:2454] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e73170c2fe0545f3954f5e5574e0c009 in term 0.
I20260811 16:58:35.626446 15336 raft_consensus.cc:2781] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:35.626713 15336 raft_consensus.cc:482] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:35.626993 15336 raft_consensus.cc:3037] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:35.632763 15336 raft_consensus.cc:504] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.634464 15336 leader_election.cc:288] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [CANDIDATE]: Term 1 election: Requested vote from peers 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219), 1c16b280d5644f5f97e958eda4bc6d71 (127.10.149.67:40625)
I20260811 16:58:35.635455 15132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c729a56be0d14da99bad39b83084527d" candidate_uuid: "e73170c2fe0545f3954f5e5574e0c009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4994ae42db7b467681ec4e6054d7a2b7"
I20260811 16:58:35.635735 15262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c729a56be0d14da99bad39b83084527d" candidate_uuid: "e73170c2fe0545f3954f5e5574e0c009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c16b280d5644f5f97e958eda4bc6d71"
I20260811 16:58:35.636062 15132 raft_consensus.cc:3037] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:35.636445 15262 raft_consensus.cc:3037] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:35.642030 15132 raft_consensus.cc:2454] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e73170c2fe0545f3954f5e5574e0c009 in term 1.
I20260811 16:58:35.642509 15262 raft_consensus.cc:2454] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e73170c2fe0545f3954f5e5574e0c009 in term 1.
I20260811 16:58:35.643425 14931 leader_election.cc:302] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4994ae42db7b467681ec4e6054d7a2b7, e73170c2fe0545f3954f5e5574e0c009; no voters:
I20260811 16:58:35.644259 15336 raft_consensus.cc:2781] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:35.645507 15336 raft_consensus.cc:686] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 LEADER]: Becoming Leader. State: Replica: e73170c2fe0545f3954f5e5574e0c009, State: Running, Role: LEADER
I20260811 16:58:35.646373 15336 consensus_queue.cc:237] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.653249 14803 catalog_manager.cc:5495] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 reported cstate change: term changed from 0 to 1, leader changed from <none> to e73170c2fe0545f3954f5e5574e0c009 (127.10.149.65). New cstate: current_term: 1 leader_uuid: "e73170c2fe0545f3954f5e5574e0c009" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:35.706066 15114 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:36214
I20260811 16:58:35.707993 15351 tablet_replica.cc:330] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: stopping tablet replica
I20260811 16:58:35.708532 15351 raft_consensus.cc:2229] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:35.708906 15351 raft_consensus.cc:2258] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:35.710877 15351 ts_tablet_manager.cc:1905] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:58:35.721278 15351 ts_tablet_manager.cc:1918] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260811 16:58:35.721777 15351 log.cc:1196] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root/wals/c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.726346 15352 ts_tablet_manager.cc:927] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Initiating tablet copy from peer e73170c2fe0545f3954f5e5574e0c009 (127.10.149.65:43555)
I20260811 16:58:35.728331 15352 tablet_copy_client.cc:316] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet copy: Beginning tablet copy session from remote peer at address 127.10.149.65:43555
I20260811 16:58:35.739931 15016 tablet_copy_service.cc:140] P e73170c2fe0545f3954f5e5574e0c009: Received BeginTabletCopySession request for tablet c729a56be0d14da99bad39b83084527d from peer 4994ae42db7b467681ec4e6054d7a2b7 ({username='slave'} at 127.0.0.1:52094)
I20260811 16:58:35.740563 15016 tablet_copy_service.cc:161] P e73170c2fe0545f3954f5e5574e0c009: Beginning new tablet copy session on tablet c729a56be0d14da99bad39b83084527d from peer 4994ae42db7b467681ec4e6054d7a2b7 at {username='slave'} at 127.0.0.1:52094: session id = 4994ae42db7b467681ec4e6054d7a2b7-c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.746618 15016 tablet_copy_source_session.cc:205] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:58:35.749606 15352 ts_tablet_manager.cc:1905] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260811 16:58:35.760247 15352 ts_tablet_manager.cc:1918] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260811 16:58:35.760985 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c729a56be0d14da99bad39b83084527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:35.766867 15352 tablet_copy_client.cc:791] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet copy: Starting download of 0 data blocks...
I20260811 16:58:35.767560 15352 tablet_copy_client.cc:655] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet copy: Starting download of 1 WAL segments...
I20260811 16:58:35.769608 14803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49268:
table { table_id: "aa045e3a25c9425db60b2a5beb9a24a0" table_name: "test-table" }
I20260811 16:58:35.770432 14803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49268:
table { table_id: "aa045e3a25c9425db60b2a5beb9a24a0" table_name: "test-table" }
I20260811 16:58:35.772328 15352 tablet_copy_client.cc:531] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:58:35.779634 15352 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Bootstrap starting.
I20260811 16:58:35.781023 14803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: Sending DeleteTablet for 3 replicas of tablet c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.783488 14978 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:58:35 UTC) from {username='slave'} at 127.0.0.1:52076
I20260811 16:58:35.783661 15114 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:58:35 UTC) from {username='slave'} at 127.0.0.1:36190
I20260811 16:58:35.785302 15245 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:58:35 UTC) from {username='slave'} at 127.0.0.1:36344
W20260811 16:58:35.786972 14779 catalog_manager.cc:4821] TS 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219): delete failed for tablet c729a56be0d14da99bad39b83084527d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c729a56be0d14da99bad39b83084527d already in progress: copying tablet
I20260811 16:58:35.787293 15355 tablet_replica.cc:330] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: stopping tablet replica
I20260811 16:58:35.788318 15355 raft_consensus.cc:2229] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:35.789217 15358 tablet_replica.cc:330] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: stopping tablet replica
I20260811 16:58:35.789449 15355 pending_rounds.cc:62] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Trying to abort 1 pending ops.
I20260811 16:58:35.790059 15358 raft_consensus.cc:2229] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:35.789882 15355 pending_rounds.cc:68] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317370944094769152 op_type: NO_OP noop_request { }
I20260811 16:58:35.790587 15355 raft_consensus.cc:2866] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:58:35.790652 15358 raft_consensus.cc:2258] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:35.791131 15355 raft_consensus.cc:2258] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:35.793524 15358 ts_tablet_manager.cc:1905] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:58:35.794519 15355 ts_tablet_manager.cc:1905] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:58:35.800463 15352 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260811 16:58:35.801633 15352 tablet_bootstrap.cc:492] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Bootstrap complete.
I20260811 16:58:35.802402 15352 ts_tablet_manager.cc:1397] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.007s
I20260811 16:58:35.805473 15352 raft_consensus.cc:348] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.806527 15352 raft_consensus.cc:729] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4994ae42db7b467681ec4e6054d7a2b7, State: Initialized, Role: FOLLOWER
I20260811 16:58:35.807740 15358 ts_tablet_manager.cc:1918] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 16:58:35.807288 15352 consensus_queue.cc:260] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4994ae42db7b467681ec4e6054d7a2b7" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 46219 } } peers { permanent_uuid: "e73170c2fe0545f3954f5e5574e0c009" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43555 } } peers { permanent_uuid: "1c16b280d5644f5f97e958eda4bc6d71" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 40625 } }
I20260811 16:58:35.808265 15358 log.cc:1196] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-2-root/wals/c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.809100 15358 ts_tablet_manager.cc:1939] T c729a56be0d14da99bad39b83084527d P 1c16b280d5644f5f97e958eda4bc6d71: Deleting consensus metadata
I20260811 16:58:35.809859 15352 ts_tablet_manager.cc:1428] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
W20260811 16:58:35.810165 15352 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260811 16:58:35.812376 15355 ts_tablet_manager.cc:1918] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 16:58:35.812498 14778 catalog_manager.cc:4841] TS 1c16b280d5644f5f97e958eda4bc6d71 (127.10.149.67:40625): tablet c729a56be0d14da99bad39b83084527d (table test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]) successfully deleted
I20260811 16:58:35.813020 15355 log.cc:1196] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-0-root/wals/c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.814019 15355 ts_tablet_manager.cc:1939] T c729a56be0d14da99bad39b83084527d P e73170c2fe0545f3954f5e5574e0c009: Deleting consensus metadata
I20260811 16:58:35.815810 14775 catalog_manager.cc:4841] TS e73170c2fe0545f3954f5e5574e0c009 (127.10.149.65:43555): tablet c729a56be0d14da99bad39b83084527d (table test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]) successfully deleted
I20260811 16:58:35.816370 15114 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:58:35 UTC) from {username='slave'} at 127.0.0.1:36190
W20260811 16:58:35.817855 14779 catalog_manager.cc:4821] TS 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219): delete failed for tablet c729a56be0d14da99bad39b83084527d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c729a56be0d14da99bad39b83084527d already in progress: copying tablet
I20260811 16:58:35.862494 15016 tablet_copy_service.cc:342] P e73170c2fe0545f3954f5e5574e0c009: Request end of tablet copy session 4994ae42db7b467681ec4e6054d7a2b7-c729a56be0d14da99bad39b83084527d received from {username='slave'} at 127.0.0.1:52094
I20260811 16:58:35.863039 15016 tablet_copy_service.cc:433] P e73170c2fe0545f3954f5e5574e0c009: ending tablet copy session 4994ae42db7b467681ec4e6054d7a2b7-c729a56be0d14da99bad39b83084527d on tablet c729a56be0d14da99bad39b83084527d with peer 4994ae42db7b467681ec4e6054d7a2b7
I20260811 16:58:35.866858 15114 tablet_service.cc:1514] Processing DeleteTablet for tablet c729a56be0d14da99bad39b83084527d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:58:35 UTC) from {username='slave'} at 127.0.0.1:36190
I20260811 16:58:35.867902 15351 tablet_replica.cc:330] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: stopping tablet replica
I20260811 16:58:35.868746 15351 raft_consensus.cc:2229] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:35.869261 15351 pending_rounds.cc:62] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Trying to abort 1 pending ops.
I20260811 16:58:35.869585 15351 pending_rounds.cc:68] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317370944094769152 op_type: NO_OP noop_request { }
I20260811 16:58:35.870030 15351 raft_consensus.cc:2866] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:58:35.870466 15351 raft_consensus.cc:2258] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:35.872897 15351 ts_tablet_manager.cc:1905] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:58:35.885293 15351 ts_tablet_manager.cc:1918] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 16:58:35.885851 15351 log.cc:1196] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786467463543483-10837-0/minicluster-data/ts-1-root/wals/c729a56be0d14da99bad39b83084527d
I20260811 16:58:35.886495 15351 ts_tablet_manager.cc:1939] T c729a56be0d14da99bad39b83084527d P 4994ae42db7b467681ec4e6054d7a2b7: Deleting consensus metadata
I20260811 16:58:35.889159 14779 catalog_manager.cc:4841] TS 4994ae42db7b467681ec4e6054d7a2b7 (127.10.149.66:46219): tablet c729a56be0d14da99bad39b83084527d (table test-table [id=aa045e3a25c9425db60b2a5beb9a24a0]) successfully deleted
I20260811 16:58:35.919966 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:35.941910 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:35.961894 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:35.971673 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:58:35.991842 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:36.010023 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:58:36.020530 10837 tablet_server.cc:178] TabletServer@127.10.149.67:0 shutting down...
I20260811 16:58:36.040874 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:36.058763 10837 tablet_server.cc:194] TabletServer@127.10.149.67:0 shutdown complete.
I20260811 16:58:36.068222 10837 master.cc:537] Master@127.10.149.126:35245 shutting down...
I20260811 16:58:36.085232 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:36.085872 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:36.086202 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P df6c7a6f4d104749b30246c8147d56b5: stopping tablet replica
I20260811 16:58:36.095400 10837 master.cc:552] Master@127.10.149.126:35245 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1325 ms)
[----------] 4 tests from TsTabletManagerITest (41137 ms total)
[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260811 16:58:36.123854 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:39043
I20260811 16:58:36.124940 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:36.130048 15368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:36.131907 15371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:36.135982 15375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:36.136529 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:36.137600 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:36.137784 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:36.137986 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467516137971 us; error 0 us; skew 500 ppm
I20260811 16:58:36.138715 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:36.141479 10837 webserver.cc:460] Webserver started at http://127.10.149.126:41679/ using document root <none> and password file <none>
I20260811 16:58:36.142025 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:36.142220 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:36.142517 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:36.143679 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "515ee95c8d6b467682d66271f3a69b38"
format_stamp: "Formatted at 2026-08-11 16:58:36 on dist-test-slave-j2vl"
I20260811 16:58:36.148737 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 16:58:36.152740 15384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:36.153697 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:36.154032 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "515ee95c8d6b467682d66271f3a69b38"
format_stamp: "Formatted at 2026-08-11 16:58:36 on dist-test-slave-j2vl"
I20260811 16:58:36.154342 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:36.166711 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:36.168411 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:36.207649 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:39043
I20260811 16:58:36.207741 15484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:39043 every 8 connection(s)
I20260811 16:58:36.211498 15486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:36.222481 15486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38: Bootstrap starting.
I20260811 16:58:36.227222 15486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:36.231586 15486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38: No bootstrap required, opened a new log
I20260811 16:58:36.233790 15486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER }
I20260811 16:58:36.234233 15486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:36.234514 15486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 515ee95c8d6b467682d66271f3a69b38, State: Initialized, Role: FOLLOWER
I20260811 16:58:36.235140 15486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER }
I20260811 16:58:36.235596 15486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:36.235814 15486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:36.236114 15486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:36.241039 15486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER }
I20260811 16:58:36.241681 15486 leader_election.cc:302] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 515ee95c8d6b467682d66271f3a69b38; no voters:
I20260811 16:58:36.242861 15486 leader_election.cc:288] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:36.243245 15489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:36.244917 15489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 1 LEADER]: Becoming Leader. State: Replica: 515ee95c8d6b467682d66271f3a69b38, State: Running, Role: LEADER
I20260811 16:58:36.245677 15489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER }
I20260811 16:58:36.245998 15486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:36.248862 15490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "515ee95c8d6b467682d66271f3a69b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER } }
I20260811 16:58:36.248875 15492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 515ee95c8d6b467682d66271f3a69b38. Latest consensus state: current_term: 1 leader_uuid: "515ee95c8d6b467682d66271f3a69b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515ee95c8d6b467682d66271f3a69b38" member_type: VOTER } }
I20260811 16:58:36.249763 15490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:36.249814 15492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:36.255723 15497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:36.263433 15497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:36.264706 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:36.272733 15497 catalog_manager.cc:1347] Generated new cluster ID: 1db71af7f4b54a90a0066d8a728bdf32
I20260811 16:58:36.273075 15497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:36.290712 15497 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:36.292425 15497 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:36.306437 15497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38: Generated new TSK 0
I20260811 16:58:36.307169 15497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:36.332050 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:36.339213 15524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:36.340220 15526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:36.341958 15528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:36.343669 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:36.344501 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:36.344681 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:36.344794 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467516344785 us; error 0 us; skew 500 ppm
I20260811 16:58:36.345327 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:36.348076 10837 webserver.cc:460] Webserver started at http://127.10.149.65:39359/ using document root <none> and password file <none>
I20260811 16:58:36.348546 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:36.348701 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:36.348920 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:36.350145 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "ba2cf162523b4398ab7e13de4db7650d"
format_stamp: "Formatted at 2026-08-11 16:58:36 on dist-test-slave-j2vl"
I20260811 16:58:36.356648 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260811 16:58:36.363330 15541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:36.364409 10837 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 16:58:36.364784 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "ba2cf162523b4398ab7e13de4db7650d"
format_stamp: "Formatted at 2026-08-11 16:58:36 on dist-test-slave-j2vl"
I20260811 16:58:36.365218 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:36.388600 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:36.390022 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:36.395360 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:36.395701 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:36.396147 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:36.396420 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:36.457111 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:46445
I20260811 16:58:36.457185 15659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:46445 every 8 connection(s)
I20260811 16:58:36.462188 15661 heartbeater.cc:347] Connected to a master server at 127.10.149.126:39043
I20260811 16:58:36.462713 15661 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:36.463764 15661 heartbeater.cc:511] Master 127.10.149.126:39043 requested a full tablet report, sending...
I20260811 16:58:36.466514 15416 ts_manager.cc:194] Registered new tserver with Master: ba2cf162523b4398ab7e13de4db7650d (127.10.149.65:46445)
I20260811 16:58:36.466678 10837 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006219323s
I20260811 16:58:36.469442 15416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48694
I20260811 16:58:36.506340 15598 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260811 16:58:36.507725 15598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:36.522712 15677 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Bootstrap starting.
I20260811 16:58:36.527465 15677 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:36.532476 15677 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: No bootstrap required, opened a new log
I20260811 16:58:36.532963 15677 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 16:58:36.535061 15677 raft_consensus.cc:348] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.535542 15677 raft_consensus.cc:374] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:36.535784 15677 raft_consensus.cc:729] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2cf162523b4398ab7e13de4db7650d, State: Initialized, Role: FOLLOWER
I20260811 16:58:36.536574 15677 consensus_queue.cc:260] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.537099 15677 raft_consensus.cc:388] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:36.537338 15677 raft_consensus.cc:482] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:36.537851 15677 raft_consensus.cc:3037] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:36.542935 15677 raft_consensus.cc:504] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.543970 15677 leader_election.cc:302] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2cf162523b4398ab7e13de4db7650d; no voters:
I20260811 16:58:36.545470 15677 leader_election.cc:288] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:36.545871 15681 raft_consensus.cc:2781] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:36.547381 15681 raft_consensus.cc:686] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 LEADER]: Becoming Leader. State: Replica: ba2cf162523b4398ab7e13de4db7650d, State: Running, Role: LEADER
I20260811 16:58:36.547533 15661 heartbeater.cc:503] Master 127.10.149.126:39043 was elected leader, sending a full tablet report...
I20260811 16:58:36.548002 15677 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260811 16:58:36.548234 15681 consensus_queue.cc:237] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.553146 15683 tablet_replica.cc:439] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: TxnStatusTablet state changed. Reason: New leader ba2cf162523b4398ab7e13de4db7650d. Latest consensus state: current_term: 1 leader_uuid: "ba2cf162523b4398ab7e13de4db7650d" committed_config { opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } } }
I20260811 16:58:36.554178 15683 tablet_replica.cc:442] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:36.554685 15682 tablet_replica.cc:439] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba2cf162523b4398ab7e13de4db7650d" committed_config { opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } } }
I20260811 16:58:36.555316 15682 tablet_replica.cc:442] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:36.556329 15689 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:58:36.556892 15689 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260811 16:58:36.558491 15416 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260811 16:58:36.563063 15416 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:36.593618 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:36.617005 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:36.617962 10837 tablet_replica.cc:330] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: stopping tablet replica
I20260811 16:58:36.618515 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:36.619156 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:36.643086 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:36.658205 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:36.665606 15695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:36.666079 15696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:36.670424 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:36.674103 15698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:36.675410 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:36.675686 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:36.675935 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467516675896 us; error 0 us; skew 500 ppm
I20260811 16:58:36.676627 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:36.679952 10837 webserver.cc:460] Webserver started at http://127.10.149.65:39359/ using document root <none> and password file <none>
I20260811 16:58:36.680488 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:36.680668 10837 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260811 16:58:36.684680 10837 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 16:58:36.687840 15707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:36.688836 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 16:58:36.689204 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "ba2cf162523b4398ab7e13de4db7650d"
format_stamp: "Formatted at 2026-08-11 16:58:36 on dist-test-slave-j2vl"
I20260811 16:58:36.689613 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:36.712561 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:36.714018 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:36.722507 15725 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 16:58:36.730894 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:58:36.731258 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.002s
I20260811 16:58:36.731580 10837 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:58:36.737772 10837 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:58:36.738027 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.006s user 0.006s sys 0.000s
I20260811 16:58:36.738186 15725 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Bootstrap starting.
I20260811 16:58:36.771445 15725 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:58:36.772555 15725 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Bootstrap complete.
I20260811 16:58:36.773257 15725 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.005s
I20260811 16:58:36.776235 15725 raft_consensus.cc:348] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.777050 15725 raft_consensus.cc:729] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2cf162523b4398ab7e13de4db7650d, State: Initialized, Role: FOLLOWER
I20260811 16:58:36.778028 15725 consensus_queue.cc:260] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.778746 15725 raft_consensus.cc:388] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:36.779080 15725 raft_consensus.cc:482] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:36.779435 15725 raft_consensus.cc:3037] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:36.787400 15725 raft_consensus.cc:504] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.788208 15725 leader_election.cc:302] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2cf162523b4398ab7e13de4db7650d; no voters:
I20260811 16:58:36.796315 15740 raft_consensus.cc:2781] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:58:36.797636 15725 leader_election.cc:288] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:58:36.802919 15725 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d: Time spent starting tablet: real 0.029s user 0.011s sys 0.013s
I20260811 16:58:36.804229 15740 raft_consensus.cc:686] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 2 LEADER]: Becoming Leader. State: Replica: ba2cf162523b4398ab7e13de4db7650d, State: Running, Role: LEADER
I20260811 16:58:36.805064 15740 consensus_queue.cc:237] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } }
I20260811 16:58:36.811976 15743 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba2cf162523b4398ab7e13de4db7650d" committed_config { opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } } }
I20260811 16:58:36.812588 15743 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:36.813865 15744 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader ba2cf162523b4398ab7e13de4db7650d. Latest consensus state: current_term: 2 leader_uuid: "ba2cf162523b4398ab7e13de4db7650d" committed_config { opid_index: -1 peers { permanent_uuid: "ba2cf162523b4398ab7e13de4db7650d" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 46445 } } }
I20260811 16:58:36.814416 15744 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:36.829809 15754 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:58:36.830713 15754 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:58:36.876029 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:46445
I20260811 16:58:36.876214 15844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:46445 every 8 connection(s)
I20260811 16:58:36.883277 15845 heartbeater.cc:347] Connected to a master server at 127.10.149.126:39043
I20260811 16:58:36.883996 15845 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:36.885255 15845 heartbeater.cc:511] Master 127.10.149.126:39043 requested a full tablet report, sending...
I20260811 16:58:36.885669 10837 tablet_server.cc:178] TabletServer@127.10.149.65:46445 shutting down...
I20260811 16:58:36.890147 15416 ts_manager.cc:194] Re-registered known tserver with Master: ba2cf162523b4398ab7e13de4db7650d (127.10.149.65:46445)
W20260811 16:58:36.891018 15416 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:36.892808 15416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48706
I20260811 16:58:36.897225 15845 heartbeater.cc:503] Master 127.10.149.126:39043 was elected leader, sending a full tablet report...
W20260811 16:58:36.901207 15416 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:36.929164 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:36.930089 10837 tablet_replica.cc:330] stopping tablet replica
I20260811 16:58:36.930733 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:58:36.931265 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P ba2cf162523b4398ab7e13de4db7650d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:36.948287 10837 tablet_server.cc:194] TabletServer@127.10.149.65:46445 shutdown complete.
I20260811 16:58:36.965626 10837 master.cc:537] Master@127.10.149.126:39043 shutting down...
I20260811 16:58:36.990819 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:36.991536 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:36.991894 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 515ee95c8d6b467682d66271f3a69b38: stopping tablet replica
I20260811 16:58:37.012665 10837 master.cc:552] Master@127.10.149.126:39043 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (915 ms)
[ RUN ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260811 16:58:37.039999 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:34113
I20260811 16:58:37.041113 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:37.047259 15857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.048254 15858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.050493 15862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.051266 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:37.052241 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:37.052490 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:37.052682 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467517052668 us; error 0 us; skew 500 ppm
I20260811 16:58:37.053471 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:37.056877 10837 webserver.cc:460] Webserver started at http://127.10.149.126:36861/ using document root <none> and password file <none>
I20260811 16:58:37.057595 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:37.057847 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:37.058175 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:37.059922 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "826972520d4f4b4faaaf627c4194b734"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.066722 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260811 16:58:37.071568 15868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.072582 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:58:37.072975 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "826972520d4f4b4faaaf627c4194b734"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.073392 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:37.095191 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:37.096644 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:37.153528 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:34113
I20260811 16:58:37.153638 15954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:34113 every 8 connection(s)
I20260811 16:58:37.158051 15955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:37.168896 15955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734: Bootstrap starting.
I20260811 16:58:37.173134 15955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:37.178009 15955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734: No bootstrap required, opened a new log
I20260811 16:58:37.180583 15955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER }
I20260811 16:58:37.181092 15955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:37.181455 15955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 826972520d4f4b4faaaf627c4194b734, State: Initialized, Role: FOLLOWER
I20260811 16:58:37.182077 15955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER }
I20260811 16:58:37.182587 15955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:37.182813 15955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:37.183108 15955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:37.188508 15955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER }
I20260811 16:58:37.189137 15955 leader_election.cc:302] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 826972520d4f4b4faaaf627c4194b734; no voters:
I20260811 16:58:37.190716 15955 leader_election.cc:288] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:37.191093 15962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:37.193197 15962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 1 LEADER]: Becoming Leader. State: Replica: 826972520d4f4b4faaaf627c4194b734, State: Running, Role: LEADER
I20260811 16:58:37.194101 15962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER }
I20260811 16:58:37.194761 15955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:37.197152 15963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "826972520d4f4b4faaaf627c4194b734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER } }
I20260811 16:58:37.197760 15963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:37.205173 15964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 826972520d4f4b4faaaf627c4194b734. Latest consensus state: current_term: 1 leader_uuid: "826972520d4f4b4faaaf627c4194b734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "826972520d4f4b4faaaf627c4194b734" member_type: VOTER } }
I20260811 16:58:37.206290 15964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:37.208262 15970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:37.216521 15970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:37.219676 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:37.227066 15970 catalog_manager.cc:1347] Generated new cluster ID: 55fe6f06606341d1a4c93618997e3cf5
I20260811 16:58:37.227391 15970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:37.254572 15970 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:37.256304 15970 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:37.279269 15970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734: Generated new TSK 0
I20260811 16:58:37.280254 15970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:37.286808 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:37.294507 15992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.296657 15994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.298841 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:37.298796 15998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.300128 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:37.300367 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:37.300546 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467517300531 us; error 0 us; skew 500 ppm
I20260811 16:58:37.301074 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:37.304272 10837 webserver.cc:460] Webserver started at http://127.10.149.65:44951/ using document root <none> and password file <none>
I20260811 16:58:37.304791 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:37.305011 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:37.305282 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:37.306478 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.311517 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 16:58:37.315428 16006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.316614 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:58:37.317058 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.317602 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:37.343998 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:37.345439 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:37.356769 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:37.357088 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.357424 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:37.357630 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.440549 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:35561
I20260811 16:58:37.440661 16120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:35561 every 8 connection(s)
I20260811 16:58:37.446559 16121 heartbeater.cc:347] Connected to a master server at 127.10.149.126:34113
I20260811 16:58:37.446549 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:58:37.447127 16121 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:37.447852 16121 heartbeater.cc:511] Master 127.10.149.126:34113 requested a full tablet report, sending...
I20260811 16:58:37.449766 15898 ts_manager.cc:194] Registered new tserver with Master: ce6e1586fd2d4a17bdb2bb98a86f9831 (127.10.149.65:35561)
I20260811 16:58:37.451781 15898 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38690
W20260811 16:58:37.456284 16124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.457845 16125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.460762 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:37.461980 16131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.463068 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:37.463373 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:37.463573 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467517463560 us; error 0 us; skew 500 ppm
I20260811 16:58:37.464286 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:37.467522 10837 webserver.cc:460] Webserver started at http://127.10.149.66:42037/ using document root <none> and password file <none>
I20260811 16:58:37.468165 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:37.468417 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:37.468734 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:37.470458 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "dcd5a9339dd54669b8e5c7cd9d74ce1d"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.477711 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260811 16:58:37.482698 16137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.483819 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 16:58:37.484241 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "dcd5a9339dd54669b8e5c7cd9d74ce1d"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.484624 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:37.509083 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:37.510587 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:37.518425 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:37.518754 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.519070 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:37.519271 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.593176 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:40963
I20260811 16:58:37.593268 16247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:40963 every 8 connection(s)
I20260811 16:58:37.601675 16249 heartbeater.cc:347] Connected to a master server at 127.10.149.126:34113
I20260811 16:58:37.602231 16249 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:37.603219 16249 heartbeater.cc:511] Master 127.10.149.126:34113 requested a full tablet report, sending...
I20260811 16:58:37.605933 15898 ts_manager.cc:194] Registered new tserver with Master: dcd5a9339dd54669b8e5c7cd9d74ce1d (127.10.149.66:40963)
I20260811 16:58:37.606235 10837 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.006641561s
I20260811 16:58:37.608549 15898 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38700
I20260811 16:58:37.658964 16061 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260811 16:58:37.660768 16061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:37.678274 16261 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Bootstrap starting.
I20260811 16:58:37.682922 16261 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:37.687460 16261 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: No bootstrap required, opened a new log
I20260811 16:58:37.687914 16261 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260811 16:58:37.690258 16261 raft_consensus.cc:348] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.690676 16261 raft_consensus.cc:374] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:37.690964 16261 raft_consensus.cc:729] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce6e1586fd2d4a17bdb2bb98a86f9831, State: Initialized, Role: FOLLOWER
I20260811 16:58:37.691497 16261 consensus_queue.cc:260] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.691974 16261 raft_consensus.cc:388] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:37.692211 16261 raft_consensus.cc:482] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:37.692467 16261 raft_consensus.cc:3037] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:37.698133 16261 raft_consensus.cc:504] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.698753 16261 leader_election.cc:302] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce6e1586fd2d4a17bdb2bb98a86f9831; no voters:
I20260811 16:58:37.700791 16261 leader_election.cc:288] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:37.701195 16263 raft_consensus.cc:2781] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:37.703307 16121 heartbeater.cc:503] Master 127.10.149.126:34113 was elected leader, sending a full tablet report...
I20260811 16:58:37.705411 16261 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Time spent starting tablet: real 0.017s user 0.014s sys 0.003s
I20260811 16:58:37.706790 16263 raft_consensus.cc:686] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 LEADER]: Becoming Leader. State: Replica: ce6e1586fd2d4a17bdb2bb98a86f9831, State: Running, Role: LEADER
I20260811 16:58:37.707635 16263 consensus_queue.cc:237] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.710747 16265 tablet_replica.cc:439] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: TxnStatusTablet state changed. Reason: New leader ce6e1586fd2d4a17bdb2bb98a86f9831. Latest consensus state: current_term: 1 leader_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" committed_config { opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } } }
I20260811 16:58:37.710966 16264 tablet_replica.cc:439] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" committed_config { opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } } }
I20260811 16:58:37.711356 16265 tablet_replica.cc:442] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:37.711500 16264 tablet_replica.cc:442] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:37.713158 16267 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:58:37.713728 16267 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260811 16:58:37.714879 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260811 16:58:37.723459 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:37.773917 16274 ts_tablet_manager.cc:927] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Initiating tablet copy from peer ce6e1586fd2d4a17bdb2bb98a86f9831 (127.10.149.65:35561)
I20260811 16:58:37.776381 16274 tablet_copy_client.cc:316] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.149.65:35561
I20260811 16:58:37.789783 16094 tablet_copy_service.cc:140] P ce6e1586fd2d4a17bdb2bb98a86f9831: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer dcd5a9339dd54669b8e5c7cd9d74ce1d ({username='slave'} at 127.0.0.1:58926)
I20260811 16:58:37.790343 16094 tablet_copy_service.cc:161] P ce6e1586fd2d4a17bdb2bb98a86f9831: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer dcd5a9339dd54669b8e5c7cd9d74ce1d at {username='slave'} at 127.0.0.1:58926: session id = dcd5a9339dd54669b8e5c7cd9d74ce1d-11111111111111111111111111111111
I20260811 16:58:37.796411 16094 tablet_copy_source_session.cc:205] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:58:37.800055 16274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:37.818738 16274 tablet_copy_client.cc:791] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: tablet copy: Starting download of 0 data blocks...
I20260811 16:58:37.819399 16274 tablet_copy_client.cc:655] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: tablet copy: Starting download of 1 WAL segments...
I20260811 16:58:37.823621 16274 tablet_copy_client.cc:531] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:58:37.832549 16274 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Bootstrap starting.
I20260811 16:58:37.860842 16274 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:58:37.861753 16274 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Bootstrap complete.
I20260811 16:58:37.862390 16274 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Time spent bootstrapping tablet: real 0.030s user 0.031s sys 0.000s
I20260811 16:58:37.864670 16274 raft_consensus.cc:348] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.865185 16274 raft_consensus.cc:729] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: dcd5a9339dd54669b8e5c7cd9d74ce1d, State: Initialized, Role: NON_PARTICIPANT
I20260811 16:58:37.865751 16274 consensus_queue.cc:260] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:37.867635 16282 tablet_replica.cc:439] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } } }
I20260811 16:58:37.867893 16249 heartbeater.cc:503] Master 127.10.149.126:34113 was elected leader, sending a full tablet report...
I20260811 16:58:37.868462 16282 tablet_replica.cc:442] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260811 16:58:37.868515 16274 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 16:58:37.871385 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:37.871912 16094 tablet_copy_service.cc:342] P ce6e1586fd2d4a17bdb2bb98a86f9831: Request end of tablet copy session dcd5a9339dd54669b8e5c7cd9d74ce1d-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:58926
I20260811 16:58:37.872463 16094 tablet_copy_service.cc:433] P ce6e1586fd2d4a17bdb2bb98a86f9831: ending tablet copy session dcd5a9339dd54669b8e5c7cd9d74ce1d-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer dcd5a9339dd54669b8e5c7cd9d74ce1d
W20260811 16:58:37.876418 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:37.884853 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:37.925415 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:37.927211 10837 tablet_replica.cc:330] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: stopping tablet replica
I20260811 16:58:37.927985 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:37.928650 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:37.942884 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:37.955678 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:37.964664 16285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.965615 16284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:37.966837 16289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:37.968293 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:37.969477 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:37.969688 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:37.969910 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467517969873 us; error 0 us; skew 500 ppm
I20260811 16:58:37.970510 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:37.974195 10837 webserver.cc:460] Webserver started at http://127.10.149.65:44951/ using document root <none> and password file <none>
I20260811 16:58:37.975219 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:37.975780 10837 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260811 16:58:37.980423 10837 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 16:58:37.984040 16297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:37.985221 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:58:37.985814 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831"
format_stamp: "Formatted at 2026-08-11 16:58:37 on dist-test-slave-j2vl"
I20260811 16:58:37.986296 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:38.010666 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:38.011862 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:38.020578 16311 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 16:58:38.030309 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:58:38.030660 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.011s user 0.001s sys 0.001s
I20260811 16:58:38.030974 10837 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:58:38.038861 16311 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Bootstrap starting.
I20260811 16:58:38.045493 10837 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:58:38.045944 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.015s user 0.008s sys 0.000s
I20260811 16:58:38.089710 16311 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:58:38.090972 16311 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Bootstrap complete.
I20260811 16:58:38.091883 16311 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Time spent bootstrapping tablet: real 0.053s user 0.031s sys 0.019s
I20260811 16:58:38.095564 16311 raft_consensus.cc:348] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:38.096410 16311 raft_consensus.cc:729] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce6e1586fd2d4a17bdb2bb98a86f9831, State: Initialized, Role: FOLLOWER
I20260811 16:58:38.097700 16311 consensus_queue.cc:260] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:38.099205 16311 raft_consensus.cc:388] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:38.099653 16311 raft_consensus.cc:482] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:38.100011 16311 raft_consensus.cc:3037] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:58:38.108786 16311 raft_consensus.cc:504] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:38.109711 16311 leader_election.cc:302] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce6e1586fd2d4a17bdb2bb98a86f9831; no voters:
I20260811 16:58:38.112442 16311 leader_election.cc:288] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:58:38.112830 16375 raft_consensus.cc:2781] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:58:38.117087 16375 raft_consensus.cc:686] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 2 LEADER]: Becoming Leader. State: Replica: ce6e1586fd2d4a17bdb2bb98a86f9831, State: Running, Role: LEADER
I20260811 16:58:38.118350 16375 consensus_queue.cc:237] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } }
I20260811 16:58:38.129451 16311 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831: Time spent starting tablet: real 0.037s user 0.027s sys 0.013s
I20260811 16:58:38.131948 16383 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" committed_config { opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } } }
I20260811 16:58:38.132714 16383 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:38.134296 16380 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader ce6e1586fd2d4a17bdb2bb98a86f9831. Latest consensus state: current_term: 2 leader_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" committed_config { opid_index: -1 peers { permanent_uuid: "ce6e1586fd2d4a17bdb2bb98a86f9831" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35561 } } }
I20260811 16:58:38.135452 16380 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:38.138116 16390 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:58:38.138623 16390 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:58:38.161489 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:35561
I20260811 16:58:38.161689 16430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:35561 every 8 connection(s)
I20260811 16:58:38.176314 10837 tablet_server.cc:178] TabletServer@127.10.149.65:35561 shutting down...
I20260811 16:58:38.181063 16431 heartbeater.cc:347] Connected to a master server at 127.10.149.126:34113
I20260811 16:58:38.182348 16431 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:38.183822 16431 heartbeater.cc:511] Master 127.10.149.126:34113 requested a full tablet report, sending...
I20260811 16:58:38.189637 15898 ts_manager.cc:194] Re-registered known tserver with Master: ce6e1586fd2d4a17bdb2bb98a86f9831 (127.10.149.65:35561)
W20260811 16:58:38.190338 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:38.193240 15898 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38732
I20260811 16:58:38.199790 16431 heartbeater.cc:503] Master 127.10.149.126:34113 was elected leader, sending a full tablet report...
W20260811 16:58:38.207319 15898 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:38.218806 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:38.219766 10837 tablet_replica.cc:330] stopping tablet replica
I20260811 16:58:38.220475 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:58:38.221043 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P ce6e1586fd2d4a17bdb2bb98a86f9831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:38.245004 10837 tablet_server.cc:194] TabletServer@127.10.149.65:35561 shutdown complete.
I20260811 16:58:38.259217 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:58:38.283388 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:38.284314 10837 tablet_replica.cc:330] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d: stopping tablet replica
I20260811 16:58:38.285053 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 16:58:38.285545 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P dcd5a9339dd54669b8e5c7cd9d74ce1d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 16:58:38.306201 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:58:38.318988 10837 master.cc:537] Master@127.10.149.126:34113 shutting down...
I20260811 16:58:38.337898 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:38.338501 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:38.338830 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 826972520d4f4b4faaaf627c4194b734: stopping tablet replica
I20260811 16:58:38.358490 10837 master.cc:552] Master@127.10.149.126:34113 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1346 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260811 16:58:38.386327 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:39515
I20260811 16:58:38.387442 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:38.393812 16438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:38.394927 16440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:38.402791 16444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:38.402968 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:38.404381 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:38.404655 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:38.404832 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467518404819 us; error 0 us; skew 500 ppm
I20260811 16:58:38.405575 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:38.408783 10837 webserver.cc:460] Webserver started at http://127.10.149.126:37221/ using document root <none> and password file <none>
I20260811 16:58:38.409534 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:38.409777 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:38.410127 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:38.411739 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a"
format_stamp: "Formatted at 2026-08-11 16:58:38 on dist-test-slave-j2vl"
I20260811 16:58:38.418469 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260811 16:58:38.423537 16455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:38.424566 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:58:38.424903 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a"
format_stamp: "Formatted at 2026-08-11 16:58:38 on dist-test-slave-j2vl"
I20260811 16:58:38.425256 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:38.445111 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:38.446223 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:38.499151 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:39515
I20260811 16:58:38.499248 16545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:39515 every 8 connection(s)
I20260811 16:58:38.503784 16548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:38.523626 16548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a: Bootstrap starting.
I20260811 16:58:38.530581 16548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:38.537948 16548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a: No bootstrap required, opened a new log
I20260811 16:58:38.540218 16548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER }
I20260811 16:58:38.540673 16548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:38.540978 16548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a56a89d6346a0bb1b099c8a3b3e1a, State: Initialized, Role: FOLLOWER
I20260811 16:58:38.541956 16548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER }
I20260811 16:58:38.542476 16548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:38.542701 16548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:38.543013 16548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:38.547962 16548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER }
I20260811 16:58:38.548601 16548 leader_election.cc:302] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d3a56a89d6346a0bb1b099c8a3b3e1a; no voters:
I20260811 16:58:38.550143 16548 leader_election.cc:288] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:38.550525 16551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:38.555812 16551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a56a89d6346a0bb1b099c8a3b3e1a, State: Running, Role: LEADER
I20260811 16:58:38.557827 16551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER }
I20260811 16:58:38.558245 16548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:38.564877 16552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER } }
I20260811 16:58:38.565058 16553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d3a56a89d6346a0bb1b099c8a3b3e1a. Latest consensus state: current_term: 1 leader_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3a56a89d6346a0bb1b099c8a3b3e1a" member_type: VOTER } }
I20260811 16:58:38.565639 16552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:38.565665 16553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:38.583894 16557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:38.590199 16557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:38.599094 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:38.604112 16557 catalog_manager.cc:1347] Generated new cluster ID: 3ff0c69786b3466ca5f5e350895807f1
I20260811 16:58:38.604473 16557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:38.636142 16557 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:38.638965 16557 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:38.668562 16557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a: Generated new TSK 0
I20260811 16:58:38.669318 16557 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:38.735057 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:38.743752 16575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:38.745379 16577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:38.747557 16580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:38.747622 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:38.749125 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:38.749475 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:38.749675 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467518749656 us; error 0 us; skew 500 ppm
I20260811 16:58:38.750424 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:38.753909 10837 webserver.cc:460] Webserver started at http://127.10.149.65:43613/ using document root <none> and password file <none>
I20260811 16:58:38.754626 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:38.754896 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:38.755242 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:38.756836 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "2863c1bba98047949d95313c2254fc58"
format_stamp: "Formatted at 2026-08-11 16:58:38 on dist-test-slave-j2vl"
I20260811 16:58:38.763443 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260811 16:58:38.768572 16589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:38.769753 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:58:38.770174 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "2863c1bba98047949d95313c2254fc58"
format_stamp: "Formatted at 2026-08-11 16:58:38 on dist-test-slave-j2vl"
I20260811 16:58:38.770640 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:38.791337 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:38.792804 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:38.803369 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:38.803704 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:38.804049 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:38.804267 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:38.878139 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:42969
I20260811 16:58:38.878463 16710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:42969 every 8 connection(s)
I20260811 16:58:38.885391 16712 heartbeater.cc:347] Connected to a master server at 127.10.149.126:39515
I20260811 16:58:38.885877 16712 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:38.886799 16712 heartbeater.cc:511] Master 127.10.149.126:39515 requested a full tablet report, sending...
I20260811 16:58:38.889282 16486 ts_manager.cc:194] Registered new tserver with Master: 2863c1bba98047949d95313c2254fc58 (127.10.149.65:42969)
I20260811 16:58:38.889429 10837 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006469981s
I20260811 16:58:38.892204 16486 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36454
I20260811 16:58:38.937922 16654 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260811 16:58:38.939641 16654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:38.959312 16726 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: Bootstrap starting.
I20260811 16:58:38.966140 16726 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:38.970853 16726 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: No bootstrap required, opened a new log
I20260811 16:58:38.971338 16726 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260811 16:58:38.974092 16726 raft_consensus.cc:348] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } }
I20260811 16:58:38.974612 16726 raft_consensus.cc:374] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:38.975039 16726 raft_consensus.cc:729] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2863c1bba98047949d95313c2254fc58, State: Initialized, Role: FOLLOWER
I20260811 16:58:38.975924 16726 consensus_queue.cc:260] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } }
I20260811 16:58:38.976506 16726 raft_consensus.cc:388] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:38.976740 16726 raft_consensus.cc:482] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:38.977029 16726 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:38.984071 16726 raft_consensus.cc:504] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } }
I20260811 16:58:38.984774 16726 leader_election.cc:302] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2863c1bba98047949d95313c2254fc58; no voters:
I20260811 16:58:38.986559 16726 leader_election.cc:288] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:38.987028 16729 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:38.989136 16729 raft_consensus.cc:686] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 1 LEADER]: Becoming Leader. State: Replica: 2863c1bba98047949d95313c2254fc58, State: Running, Role: LEADER
I20260811 16:58:38.989004 16712 heartbeater.cc:503] Master 127.10.149.126:39515 was elected leader, sending a full tablet report...
I20260811 16:58:38.990615 16726 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: Time spent starting tablet: real 0.019s user 0.019s sys 0.000s
I20260811 16:58:38.990458 16729 consensus_queue.cc:237] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } }
I20260811 16:58:38.994575 16733 tablet_replica.cc:439] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: TxnStatusTablet state changed. Reason: New leader 2863c1bba98047949d95313c2254fc58. Latest consensus state: current_term: 1 leader_uuid: "2863c1bba98047949d95313c2254fc58" committed_config { opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } } }
I20260811 16:58:38.995235 16733 tablet_replica.cc:442] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:38.996793 16731 tablet_replica.cc:439] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2863c1bba98047949d95313c2254fc58" committed_config { opid_index: -1 peers { permanent_uuid: "2863c1bba98047949d95313c2254fc58" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 42969 } } }
I20260811 16:58:38.997428 16731 tablet_replica.cc:442] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: This TxnStatusTablet replica's current role is: LEADER
W20260811 16:58:38.999918 16486 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:39.001513 16735 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:58:39.002030 16735 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260811 16:58:39.005893 16486 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260811 16:58:39.066691 16640 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260811 16:58:39.067090 16640 txn_status_manager.cc:243] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260811 16:58:39.067479 16640 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260811 16:58:39.077827 16640 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260811 16:58:39.133415 16640 txn_status_manager.cc:243] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260811 16:58:39.133839 16640 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260811 16:58:39.143891 16640 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260811 16:58:39.158202 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.160514 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.162473 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.164413 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.166805 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.169139 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:59836
W20260811 16:58:39.182931 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
W20260811 16:58:39.185115 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
W20260811 16:58:39.187237 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
W20260811 16:58:39.189606 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
W20260811 16:58:39.191679 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
W20260811 16:58:39.193847 16654 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:59850
I20260811 16:58:39.197193 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:39.227811 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:39.228641 10837 tablet_replica.cc:330] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58: stopping tablet replica
I20260811 16:58:39.229266 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:39.229883 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 2863c1bba98047949d95313c2254fc58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:39.254891 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:39.272454 10837 master.cc:537] Master@127.10.149.126:39515 shutting down...
I20260811 16:58:39.292717 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:39.293283 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:39.293674 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2d3a56a89d6346a0bb1b099c8a3b3e1a: stopping tablet replica
I20260811 16:58:39.312757 10837 master.cc:552] Master@127.10.149.126:39515 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (953 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260811 16:58:39.339962 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:43837
I20260811 16:58:39.341689 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:39.349278 16747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:39.350116 16749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:39.352488 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:39.352648 16752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:39.353670 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:39.353878 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:39.354027 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467519354012 us; error 0 us; skew 500 ppm
I20260811 16:58:39.354518 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:39.358009 10837 webserver.cc:460] Webserver started at http://127.10.149.126:37861/ using document root <none> and password file <none>
I20260811 16:58:39.358522 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:39.358695 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:39.359145 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:39.360299 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "2d07eef8abb044849219aec0cecf3444"
format_stamp: "Formatted at 2026-08-11 16:58:39 on dist-test-slave-j2vl"
I20260811 16:58:39.365893 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 16:58:39.370301 16760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:39.371363 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 16:58:39.371727 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "2d07eef8abb044849219aec0cecf3444"
format_stamp: "Formatted at 2026-08-11 16:58:39 on dist-test-slave-j2vl"
I20260811 16:58:39.372078 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:39.388339 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:39.389568 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:39.434324 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:43837
I20260811 16:58:39.434463 16854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:43837 every 8 connection(s)
I20260811 16:58:39.438782 16857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:39.452051 16857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444: Bootstrap starting.
I20260811 16:58:39.456598 16857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:39.461329 16857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444: No bootstrap required, opened a new log
I20260811 16:58:39.463466 16857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER }
I20260811 16:58:39.463893 16857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:39.464156 16857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d07eef8abb044849219aec0cecf3444, State: Initialized, Role: FOLLOWER
I20260811 16:58:39.464865 16857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER }
I20260811 16:58:39.465390 16857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:39.465646 16857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:39.465916 16857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:39.470837 16857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER }
I20260811 16:58:39.471451 16857 leader_election.cc:302] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d07eef8abb044849219aec0cecf3444; no voters:
I20260811 16:58:39.473278 16857 leader_election.cc:288] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:39.473661 16861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:39.475360 16861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 1 LEADER]: Becoming Leader. State: Replica: 2d07eef8abb044849219aec0cecf3444, State: Running, Role: LEADER
I20260811 16:58:39.476172 16861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER }
I20260811 16:58:39.477123 16857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:39.479640 16863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d07eef8abb044849219aec0cecf3444" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER } }
I20260811 16:58:39.479719 16864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d07eef8abb044849219aec0cecf3444. Latest consensus state: current_term: 1 leader_uuid: "2d07eef8abb044849219aec0cecf3444" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d07eef8abb044849219aec0cecf3444" member_type: VOTER } }
I20260811 16:58:39.480511 16863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:39.480875 16864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:39.487046 16869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:39.492368 16869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:39.495131 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:39.502076 16869 catalog_manager.cc:1347] Generated new cluster ID: 215b208e472849b1b6a28cf94988216d
I20260811 16:58:39.502420 16869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:39.521901 16869 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:39.523648 16869 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:39.543457 16869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444: Generated new TSK 0
I20260811 16:58:39.544243 16869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:39.561971 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:39.568998 16888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:39.570856 16889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:39.572880 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:39.572781 16891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:39.574378 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:39.574573 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:39.574820 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467519574804 us; error 0 us; skew 500 ppm
I20260811 16:58:39.575413 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:39.582445 10837 webserver.cc:460] Webserver started at http://127.10.149.65:44501/ using document root <none> and password file <none>
I20260811 16:58:39.582998 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:39.583163 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:39.583678 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:39.584944 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "c84715ec015c4395ad1528da21173fea"
format_stamp: "Formatted at 2026-08-11 16:58:39 on dist-test-slave-j2vl"
I20260811 16:58:39.589975 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 16:58:39.593608 16897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:39.594503 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 16:58:39.594837 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "c84715ec015c4395ad1528da21173fea"
format_stamp: "Formatted at 2026-08-11 16:58:39 on dist-test-slave-j2vl"
I20260811 16:58:39.595115 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:39.606887 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:39.607929 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:39.612896 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:39.613210 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 16:58:39.613543 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:39.613793 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:39.670312 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:43469
I20260811 16:58:39.670456 17019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:43469 every 8 connection(s)
I20260811 16:58:39.675683 17020 heartbeater.cc:347] Connected to a master server at 127.10.149.126:43837
I20260811 16:58:39.676152 17020 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:39.677255 17020 heartbeater.cc:511] Master 127.10.149.126:43837 requested a full tablet report, sending...
I20260811 16:58:39.680327 16797 ts_manager.cc:194] Registered new tserver with Master: c84715ec015c4395ad1528da21173fea (127.10.149.65:43469)
I20260811 16:58:39.680441 10837 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006686058s
I20260811 16:58:39.682802 16797 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43490
I20260811 16:58:39.719637 16969 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260811 16:58:39.720986 16969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:39.733664 17033 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: Bootstrap starting.
I20260811 16:58:39.738626 17033 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:39.743062 17033 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: No bootstrap required, opened a new log
I20260811 16:58:39.743549 17033 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 16:58:39.745702 17033 raft_consensus.cc:348] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.746202 17033 raft_consensus.cc:374] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:39.746460 17033 raft_consensus.cc:729] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84715ec015c4395ad1528da21173fea, State: Initialized, Role: FOLLOWER
I20260811 16:58:39.746995 17033 consensus_queue.cc:260] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.747506 17033 raft_consensus.cc:388] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:39.747748 17033 raft_consensus.cc:482] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:39.748032 17033 raft_consensus.cc:3037] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:39.752769 17033 raft_consensus.cc:504] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.753388 17033 leader_election.cc:302] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c84715ec015c4395ad1528da21173fea; no voters:
I20260811 16:58:39.754639 17033 leader_election.cc:288] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:39.755113 17035 raft_consensus.cc:2781] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:39.756626 17035 raft_consensus.cc:686] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 1 LEADER]: Becoming Leader. State: Replica: c84715ec015c4395ad1528da21173fea, State: Running, Role: LEADER
I20260811 16:58:39.756781 17020 heartbeater.cc:503] Master 127.10.149.126:43837 was elected leader, sending a full tablet report...
I20260811 16:58:39.757045 17033 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260811 16:58:39.757503 17035 consensus_queue.cc:237] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.762578 17037 tablet_replica.cc:439] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: TxnStatusTablet state changed. Reason: New leader c84715ec015c4395ad1528da21173fea. Latest consensus state: current_term: 1 leader_uuid: "c84715ec015c4395ad1528da21173fea" committed_config { opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } } }
I20260811 16:58:39.763384 17037 tablet_replica.cc:442] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:39.764103 17036 tablet_replica.cc:439] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c84715ec015c4395ad1528da21173fea" committed_config { opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } } }
I20260811 16:58:39.764696 17036 tablet_replica.cc:442] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:58:39.765805 17049 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
W20260811 16:58:39.766218 16797 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:39.766258 17049 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260811 16:58:39.771095 16797 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260811 16:58:39.798879 16969 tablet_service.cc:1467] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260811 16:58:39.800119 16969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:39.810698 17033 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: Bootstrap starting.
I20260811 16:58:39.815680 17033 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:39.820504 17033 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: No bootstrap required, opened a new log
I20260811 16:58:39.820916 17033 ts_tablet_manager.cc:1397] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 16:58:39.822876 17033 raft_consensus.cc:348] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.823324 17033 raft_consensus.cc:374] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:39.823515 17033 raft_consensus.cc:729] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84715ec015c4395ad1528da21173fea, State: Initialized, Role: FOLLOWER
I20260811 16:58:39.824084 17033 consensus_queue.cc:260] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.824577 17033 raft_consensus.cc:388] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:39.824770 17033 raft_consensus.cc:482] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:39.825122 17033 raft_consensus.cc:3037] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:39.831238 17033 raft_consensus.cc:504] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
I20260811 16:58:39.831897 17033 leader_election.cc:302] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c84715ec015c4395ad1528da21173fea; no voters:
I20260811 16:58:39.832428 17033 leader_election.cc:288] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:39.832621 17037 raft_consensus.cc:2781] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:39.833561 17037 raft_consensus.cc:686] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 1 LEADER]: Becoming Leader. State: Replica: c84715ec015c4395ad1528da21173fea, State: Running, Role: LEADER
I20260811 16:58:39.834331 17033 ts_tablet_manager.cc:1428] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260811 16:58:39.834409 17037 consensus_queue.cc:237] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "c84715ec015c4395ad1528da21173fea" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 43469 } }
W20260811 16:58:39.840713 16797 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260811 16:58:39.846189 16797 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260811 16:58:39.864977 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:39.903868 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:39.904608 10837 tablet_replica.cc:330] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea: stopping tablet replica
I20260811 16:58:39.905102 10837 raft_consensus.cc:2229] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:39.905613 10837 raft_consensus.cc:2258] T 22222222222222222222222222222222 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:39.908130 10837 tablet_replica.cc:330] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea: stopping tablet replica
I20260811 16:58:39.908599 10837 raft_consensus.cc:2229] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:39.908995 10837 raft_consensus.cc:2258] T 11111111111111111111111111111111 P c84715ec015c4395ad1528da21173fea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:39.932217 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:39.945289 10837 master.cc:537] Master@127.10.149.126:43837 shutting down...
I20260811 16:58:39.965031 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:39.965751 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:39.966245 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2d07eef8abb044849219aec0cecf3444: stopping tablet replica
I20260811 16:58:39.989043 10837 master.cc:552] Master@127.10.149.126:43837 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (677 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3893 ms total)
[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/0
I20260811 16:58:40.016882 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:36011
I20260811 16:58:40.018225 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:40.024444 17061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.025895 17062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:40.029223 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:40.029412 17066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:40.030294 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:40.030516 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:40.030694 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467520030679 us; error 0 us; skew 500 ppm
I20260811 16:58:40.031277 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:40.034034 10837 webserver.cc:460] Webserver started at http://127.10.149.126:39745/ using document root <none> and password file <none>
I20260811 16:58:40.034554 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:40.034776 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:40.035063 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:40.036232 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.041481 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 16:58:40.045213 17075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.046300 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:40.046563 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.047035 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:40.083635 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:40.084704 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:40.126082 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:36011
I20260811 16:58:40.126186 17168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:36011 every 8 connection(s)
I20260811 16:58:40.130548 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:40.141556 17171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8: Bootstrap starting.
I20260811 16:58:40.146078 17171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:40.150986 17171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8: No bootstrap required, opened a new log
I20260811 16:58:40.152964 17171 raft_consensus.cc:348] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER }
I20260811 16:58:40.153414 17171 raft_consensus.cc:374] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:40.153617 17171 raft_consensus.cc:729] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15cf5f3ac0b47e6851ccb7da9d47ed8, State: Initialized, Role: FOLLOWER
I20260811 16:58:40.154099 17171 consensus_queue.cc:260] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER }
I20260811 16:58:40.154497 17171 raft_consensus.cc:388] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:40.154713 17171 raft_consensus.cc:482] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:40.154938 17171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:40.159672 17171 raft_consensus.cc:504] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER }
I20260811 16:58:40.160184 17171 leader_election.cc:302] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c15cf5f3ac0b47e6851ccb7da9d47ed8; no voters:
I20260811 16:58:40.161309 17171 leader_election.cc:288] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:40.161746 17179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:40.163123 17179 raft_consensus.cc:686] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 1 LEADER]: Becoming Leader. State: Replica: c15cf5f3ac0b47e6851ccb7da9d47ed8, State: Running, Role: LEADER
I20260811 16:58:40.163832 17179 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER }
I20260811 16:58:40.164484 17171 sys_catalog.cc:564] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:40.166700 17181 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER } }
I20260811 16:58:40.166700 17182 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c15cf5f3ac0b47e6851ccb7da9d47ed8. Latest consensus state: current_term: 1 leader_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15cf5f3ac0b47e6851ccb7da9d47ed8" member_type: VOTER } }
I20260811 16:58:40.167476 17181 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:40.167631 17182 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:40.172032 17187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:40.180219 17187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:40.182673 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:40.191200 17187 catalog_manager.cc:1347] Generated new cluster ID: 24b2f34fe8704eb7a287c5ce72257830
I20260811 16:58:40.191543 17187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:40.219574 17187 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:40.221370 17187 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:40.236114 17187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8: Generated new TSK 0
I20260811 16:58:40.236917 17187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:40.250401 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:40.257711 17211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.258983 17216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.260577 17219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:40.261234 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:40.263947 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:40.264230 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:40.264416 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467520264400 us; error 0 us; skew 500 ppm
I20260811 16:58:40.265255 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:40.268412 10837 webserver.cc:460] Webserver started at http://127.10.149.65:36203/ using document root <none> and password file <none>
I20260811 16:58:40.268986 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:40.269210 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:40.269559 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:40.270848 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "0f0ba89361b84f4fb67ea50baceb389a"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.278257 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 16:58:40.282797 17225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.283933 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 16:58:40.284595 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "0f0ba89361b84f4fb67ea50baceb389a"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.285022 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:40.301440 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:40.302711 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:40.304379 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:40.307049 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:40.307299 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.307587 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:40.307755 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.353488 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:38033
I20260811 16:58:40.353514 17326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:38033 every 8 connection(s)
I20260811 16:58:40.359151 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:40.368168 17331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.370185 17333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.371289 17336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:40.374749 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:40.376469 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260811 16:58:40.376602 17327 heartbeater.cc:347] Connected to a master server at 127.10.149.126:36011
W20260811 16:58:40.376973 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:40.377135 17327 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:40.377195 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467520377176 us; error 0 us; skew 500 ppm
I20260811 16:58:40.378211 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:40.378219 17327 heartbeater.cc:511] Master 127.10.149.126:36011 requested a full tablet report, sending...
I20260811 16:58:40.382401 17113 ts_manager.cc:194] Registered new tserver with Master: 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033)
I20260811 16:58:40.383396 10837 webserver.cc:460] Webserver started at http://127.10.149.66:35605/ using document root <none> and password file <none>
I20260811 16:58:40.384136 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:40.384403 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:40.384742 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:40.385525 17113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36012
I20260811 16:58:40.386428 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "846b42a17c1b42cf899551700d99d495"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.391958 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 16:58:40.397042 17343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.398102 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:40.398468 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "846b42a17c1b42cf899551700d99d495"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.398805 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:40.418013 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:40.419263 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:40.420845 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:40.423336 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:40.423599 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.423866 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:40.424042 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.473419 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:34541
I20260811 16:58:40.473567 17452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:34541 every 8 connection(s)
I20260811 16:58:40.479316 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:40.488226 17459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.491034 17461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:40.492993 17470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:40.493544 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:40.494665 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:40.494923 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:40.495126 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467520495103 us; error 0 us; skew 500 ppm
I20260811 16:58:40.496258 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:40.497454 17453 heartbeater.cc:347] Connected to a master server at 127.10.149.126:36011
I20260811 16:58:40.497918 17453 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:40.498955 17453 heartbeater.cc:511] Master 127.10.149.126:36011 requested a full tablet report, sending...
I20260811 16:58:40.499243 10837 webserver.cc:460] Webserver started at http://127.10.149.67:43699/ using document root <none> and password file <none>
I20260811 16:58:40.499977 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:40.500262 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:40.500622 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:40.501554 17113 ts_manager.cc:194] Registered new tserver with Master: 846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541)
I20260811 16:58:40.501931 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-2-root/instance:
uuid: "3e4c427008b94c858a0ae0c052b3f504"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.503345 17113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36028
I20260811 16:58:40.507157 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 16:58:40.510789 17478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.511751 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:40.512130 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-2-root
uuid: "3e4c427008b94c858a0ae0c052b3f504"
format_stamp: "Formatted at 2026-08-11 16:58:40 on dist-test-slave-j2vl"
I20260811 16:58:40.512452 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:40.541970 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:40.543200 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:40.545213 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:40.547639 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:40.547849 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.548043 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:40.548207 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:40.595736 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.67:36859
I20260811 16:58:40.596055 17585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.67:36859 every 8 connection(s)
I20260811 16:58:40.613680 17587 heartbeater.cc:347] Connected to a master server at 127.10.149.126:36011
I20260811 16:58:40.614159 17587 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:40.615025 17587 heartbeater.cc:511] Master 127.10.149.126:36011 requested a full tablet report, sending...
I20260811 16:58:40.617573 17113 ts_manager.cc:194] Registered new tserver with Master: 3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67:36859)
I20260811 16:58:40.618153 10837 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019010542s
I20260811 16:58:40.619948 17113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36036
I20260811 16:58:40.647645 10837 test_util.cc:268] Using random seed: 1643680196
I20260811 16:58:40.683796 17113 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36058:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:58:40.730145 17390 tablet_service.cc:1467] Processing CreateTablet for tablet 31709d3af7ca4ec9aeff86d4b346ae05 (DEFAULT_TABLE table=test-workload [id=f3fb132b9f044c54a2ad6e43d9a8b0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:40.731511 17390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31709d3af7ca4ec9aeff86d4b346ae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:40.745755 17521 tablet_service.cc:1467] Processing CreateTablet for tablet 31709d3af7ca4ec9aeff86d4b346ae05 (DEFAULT_TABLE table=test-workload [id=f3fb132b9f044c54a2ad6e43d9a8b0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:40.745940 17271 tablet_service.cc:1467] Processing CreateTablet for tablet 31709d3af7ca4ec9aeff86d4b346ae05 (DEFAULT_TABLE table=test-workload [id=f3fb132b9f044c54a2ad6e43d9a8b0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:40.746872 17521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31709d3af7ca4ec9aeff86d4b346ae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:40.747177 17271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31709d3af7ca4ec9aeff86d4b346ae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:40.763010 17618 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Bootstrap starting.
I20260811 16:58:40.766539 17620 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Bootstrap starting.
I20260811 16:58:40.768504 17618 tablet_bootstrap.cc:654] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:40.770699 17617 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: Bootstrap starting.
I20260811 16:58:40.775355 17618 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: No bootstrap required, opened a new log
I20260811 16:58:40.776221 17618 ts_tablet_manager.cc:1397] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.005s
I20260811 16:58:40.777899 17620 tablet_bootstrap.cc:654] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:40.778564 17617 tablet_bootstrap.cc:654] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:40.780378 17618 raft_consensus.cc:348] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.782006 17618 raft_consensus.cc:374] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:40.782558 17618 raft_consensus.cc:729] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e4c427008b94c858a0ae0c052b3f504, State: Initialized, Role: FOLLOWER
I20260811 16:58:40.783471 17618 consensus_queue.cc:260] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.785254 17620 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: No bootstrap required, opened a new log
I20260811 16:58:40.785984 17620 ts_tablet_manager.cc:1397] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.006s
I20260811 16:58:40.786015 17587 heartbeater.cc:503] Master 127.10.149.126:36011 was elected leader, sending a full tablet report...
I20260811 16:58:40.786566 17618 ts_tablet_manager.cc:1428] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Time spent starting tablet: real 0.010s user 0.009s sys 0.001s
I20260811 16:58:40.785254 17617 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: No bootstrap required, opened a new log
I20260811 16:58:40.788091 17617 ts_tablet_manager.cc:1397] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260811 16:58:40.789214 17620 raft_consensus.cc:348] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.790113 17620 raft_consensus.cc:374] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:40.790424 17620 raft_consensus.cc:729] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0ba89361b84f4fb67ea50baceb389a, State: Initialized, Role: FOLLOWER
I20260811 16:58:40.790939 17617 raft_consensus.cc:348] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.791687 17617 raft_consensus.cc:374] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:40.791356 17620 consensus_queue.cc:260] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.792523 17617 raft_consensus.cc:729] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 846b42a17c1b42cf899551700d99d495, State: Initialized, Role: FOLLOWER
I20260811 16:58:40.793411 17617 consensus_queue.cc:260] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.794993 17327 heartbeater.cc:503] Master 127.10.149.126:36011 was elected leader, sending a full tablet report...
I20260811 16:58:40.795310 17620 ts_tablet_manager.cc:1428] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260811 16:58:40.797416 17453 heartbeater.cc:503] Master 127.10.149.126:36011 was elected leader, sending a full tablet report...
I20260811 16:58:40.797953 17617 ts_tablet_manager.cc:1428] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 16:58:40.822269 17624 raft_consensus.cc:482] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:40.823187 17624 raft_consensus.cc:504] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.827936 17624 leader_election.cc:288] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541), 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033)
I20260811 16:58:40.844738 17288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31709d3af7ca4ec9aeff86d4b346ae05" candidate_uuid: "3e4c427008b94c858a0ae0c052b3f504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0ba89361b84f4fb67ea50baceb389a" is_pre_election: true
I20260811 16:58:40.845706 17288 raft_consensus.cc:2454] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4c427008b94c858a0ae0c052b3f504 in term 0.
I20260811 16:58:40.845906 17407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31709d3af7ca4ec9aeff86d4b346ae05" candidate_uuid: "3e4c427008b94c858a0ae0c052b3f504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "846b42a17c1b42cf899551700d99d495" is_pre_election: true
I20260811 16:58:40.846624 17407 raft_consensus.cc:2454] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e4c427008b94c858a0ae0c052b3f504 in term 0.
I20260811 16:58:40.846917 17484 leader_election.cc:302] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0ba89361b84f4fb67ea50baceb389a, 3e4c427008b94c858a0ae0c052b3f504; no voters:
I20260811 16:58:40.847803 17624 raft_consensus.cc:2781] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:40.848301 17624 raft_consensus.cc:482] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:40.848773 17624 raft_consensus.cc:3037] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:40.856662 17624 raft_consensus.cc:504] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.858907 17624 leader_election.cc:288] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [CANDIDATE]: Term 1 election: Requested vote from peers 846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541), 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033)
I20260811 16:58:40.859855 17407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31709d3af7ca4ec9aeff86d4b346ae05" candidate_uuid: "3e4c427008b94c858a0ae0c052b3f504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "846b42a17c1b42cf899551700d99d495"
I20260811 16:58:40.860407 17407 raft_consensus.cc:3037] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:40.860196 17288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31709d3af7ca4ec9aeff86d4b346ae05" candidate_uuid: "3e4c427008b94c858a0ae0c052b3f504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0ba89361b84f4fb67ea50baceb389a"
I20260811 16:58:40.861445 17288 raft_consensus.cc:3037] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:40.866528 17407 raft_consensus.cc:2454] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4c427008b94c858a0ae0c052b3f504 in term 1.
I20260811 16:58:40.867195 17288 raft_consensus.cc:2454] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e4c427008b94c858a0ae0c052b3f504 in term 1.
I20260811 16:58:40.867789 17479 leader_election.cc:302] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e4c427008b94c858a0ae0c052b3f504, 846b42a17c1b42cf899551700d99d495; no voters:
I20260811 16:58:40.868714 17624 raft_consensus.cc:2781] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:40.870095 17624 raft_consensus.cc:686] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 LEADER]: Becoming Leader. State: Replica: 3e4c427008b94c858a0ae0c052b3f504, State: Running, Role: LEADER
I20260811 16:58:40.871012 17624 consensus_queue.cc:237] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:40.881971 17111 catalog_manager.cc:5495] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67). New cstate: current_term: 1 leader_uuid: "3e4c427008b94c858a0ae0c052b3f504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } } }
I20260811 16:58:41.253168 17271 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:41.262821 17390 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:41.263830 17521 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:41.302635 17624 consensus_queue.cc:1035] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:58:41.328154 17631 consensus_queue.cc:1035] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c15cf5f3ac0b47e6851ccb7da9d47ed8 | 127.10.149.126:36011 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
0f0ba89361b84f4fb67ea50baceb389a | 127.10.149.65:38033 | HEALTHY | <none> | 0 | 0
3e4c427008b94c858a0ae0c052b3f504 | 127.10.149.67:36859 | HEALTHY | <none> | 1 | 0
846b42a17c1b42cf899551700d99d495 | 127.10.149.66:34541 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 31709d3af7ca4ec9aeff86d4b346ae05 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541): RUNNING
3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67:36859): RUNNING [LEADER]
0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): RUNNING
All reported replicas are:
A = 846b42a17c1b42cf899551700d99d495
B = 3e4c427008b94c858a0ae0c052b3f504
C = 0f0ba89361b84f4fb67ea50baceb389a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:41.673730 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:42.091202 17271 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:42.107023 17521 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:42.110697 17390 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c15cf5f3ac0b47e6851ccb7da9d47ed8 | 127.10.149.126:36011 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
0f0ba89361b84f4fb67ea50baceb389a | 127.10.149.65:38033 | HEALTHY | <none> | 0 | 0
3e4c427008b94c858a0ae0c052b3f504 | 127.10.149.67:36859 | HEALTHY | <none> | 1 | 0
846b42a17c1b42cf899551700d99d495 | 127.10.149.66:34541 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260811 16:58:42.345889 10837 log_verifier.cc:126] Checking tablet 31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:42.431789 10837 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:42.432948 10837 tablet_replica.cc:330] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: stopping tablet replica
I20260811 16:58:42.433528 10837 raft_consensus.cc:2229] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:42.433941 10837 raft_consensus.cc:2258] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:42.769236 17271 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260811 16:58:42.778047 17484 consensus_peers.cc:487] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 -> Peer 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): Couldn't send request to peer 0f0ba89361b84f4fb67ea50baceb389a. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:42.783695 17390 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:42.787153 17521 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:42.791206 17631 raft_consensus.cc:998] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Attempting to remove follower 0f0ba89361b84f4fb67ea50baceb389a from the Raft config. Reason: The tablet replica hosted on peer 0f0ba89361b84f4fb67ea50baceb389a has failed
I20260811 16:58:42.794220 17631 consensus_queue.cc:237] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } }
I20260811 16:58:42.801182 17407 raft_consensus.cc:1261] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Refusing update from remote peer 3e4c427008b94c858a0ae0c052b3f504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:58:42.802870 17777 consensus_queue.cc:1035] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:58:42.812420 17631 raft_consensus.cc:2932] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } }
I20260811 16:58:42.819613 17407 raft_consensus.cc:2932] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } }
I20260811 16:58:42.832135 17110 catalog_manager.cc:5495] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 reported cstate change: config changed from index -1 to 2, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) evicted. New cstate: current_term: 1 leader_uuid: "3e4c427008b94c858a0ae0c052b3f504" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } }
I20260811 16:58:42.928875 17271 tablet_service.cc:1514] Processing DeleteTablet for tablet 31709d3af7ca4ec9aeff86d4b346ae05 with delete_type TABLET_DATA_TOMBSTONED (TS 0f0ba89361b84f4fb67ea50baceb389a not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:46770
I20260811 16:58:42.936790 17541 consensus_queue.cc:237] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:42.951190 17791 ts_tablet_manager.cc:1905] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:58:42.965250 17484 consensus_peers.cc:487] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 -> Peer 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): Couldn't send request to peer 0f0ba89361b84f4fb67ea50baceb389a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:42.969771 17407 raft_consensus.cc:1261] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Refusing update from remote peer 3e4c427008b94c858a0ae0c052b3f504: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:58:42.973845 17631 consensus_queue.cc:1035] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:42.988719 17777 raft_consensus.cc:2932] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } } }
I20260811 16:58:42.992956 17791 ts_tablet_manager.cc:1918] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260811 16:58:42.993702 17791 log.cc:1196] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786467463543483-10837-0/minicluster-data/ts-0-root/wals/31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:42.996762 17087 catalog_manager.cc:4841] TS 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): tablet 31709d3af7ca4ec9aeff86d4b346ae05 (table test-workload [id=f3fb132b9f044c54a2ad6e43d9a8b0ce]) successfully deleted
I20260811 16:58:43.001842 17407 raft_consensus.cc:2932] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } } }
I20260811 16:58:43.013511 17087 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:VOTER RPC for tablet 31709d3af7ca4ec9aeff86d4b346ae05 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260811 16:58:43.032004 17110 catalog_manager.cc:5495] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 reported cstate change: config changed from index 2 to 3, VOTER 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65) added. New cstate: current_term: 1 leader_uuid: "3e4c427008b94c858a0ae0c052b3f504" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } } }
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c15cf5f3ac0b47e6851ccb7da9d47ed8 | 127.10.149.126:36011 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
0f0ba89361b84f4fb67ea50baceb389a | 127.10.149.65:38033 | HEALTHY | <none> | 0 | 0
3e4c427008b94c858a0ae0c052b3f504 | 127.10.149.67:36859 | HEALTHY | <none> | 1 | 0
846b42a17c1b42cf899551700d99d495 | 127.10.149.66:34541 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 31709d3af7ca4ec9aeff86d4b346ae05 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541): RUNNING
3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67:36859): RUNNING [LEADER]
0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
A = 846b42a17c1b42cf899551700d99d495
B = 3e4c427008b94c858a0ae0c052b3f504
C = 0f0ba89361b84f4fb67ea50baceb389a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:43.161399 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:43.410625 17807 ts_tablet_manager.cc:927] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Initiating tablet copy from peer 3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67:36859)
I20260811 16:58:43.412858 17807 tablet_copy_client.cc:316] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet copy: Beginning tablet copy session from remote peer at address 127.10.149.67:36859
I20260811 16:58:43.428085 17561 tablet_copy_service.cc:140] P 3e4c427008b94c858a0ae0c052b3f504: Received BeginTabletCopySession request for tablet 31709d3af7ca4ec9aeff86d4b346ae05 from peer 0f0ba89361b84f4fb67ea50baceb389a ({username='slave'} at 127.0.0.1:47104)
I20260811 16:58:43.428766 17561 tablet_copy_service.cc:161] P 3e4c427008b94c858a0ae0c052b3f504: Beginning new tablet copy session on tablet 31709d3af7ca4ec9aeff86d4b346ae05 from peer 0f0ba89361b84f4fb67ea50baceb389a at {username='slave'} at 127.0.0.1:47104: session id = 0f0ba89361b84f4fb67ea50baceb389a-31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:43.434894 17561 tablet_copy_source_session.cc:205] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:58:43.438179 17807 ts_tablet_manager.cc:1905] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260811 16:58:43.459555 17807 ts_tablet_manager.cc:1918] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260811 16:58:43.460789 17807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31709d3af7ca4ec9aeff86d4b346ae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:43.469312 17807 tablet_copy_client.cc:791] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet copy: Starting download of 0 data blocks...
I20260811 16:58:43.469930 17807 tablet_copy_client.cc:655] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet copy: Starting download of 1 WAL segments...
I20260811 16:58:43.473958 17807 tablet_copy_client.cc:531] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:58:43.483464 17807 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Bootstrap starting.
I20260811 16:58:43.506124 17807 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:58:43.506997 17807 tablet_bootstrap.cc:492] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Bootstrap complete.
I20260811 16:58:43.507709 17807 ts_tablet_manager.cc:1397] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.006s
I20260811 16:58:43.510038 17807 raft_consensus.cc:348] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:43.510664 17807 raft_consensus.cc:729] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0ba89361b84f4fb67ea50baceb389a, State: Initialized, Role: FOLLOWER
I20260811 16:58:43.511325 17807 consensus_queue.cc:260] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "846b42a17c1b42cf899551700d99d495" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 34541 } } peers { permanent_uuid: "3e4c427008b94c858a0ae0c052b3f504" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 36859 } } peers { permanent_uuid: "0f0ba89361b84f4fb67ea50baceb389a" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 38033 } }
I20260811 16:58:43.516552 17807 ts_tablet_manager.cc:1428] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: Time spent starting tablet: real 0.008s user 0.002s sys 0.008s
I20260811 16:58:43.518900 17561 tablet_copy_service.cc:342] P 3e4c427008b94c858a0ae0c052b3f504: Request end of tablet copy session 0f0ba89361b84f4fb67ea50baceb389a-31709d3af7ca4ec9aeff86d4b346ae05 received from {username='slave'} at 127.0.0.1:47104
I20260811 16:58:43.519327 17561 tablet_copy_service.cc:433] P 3e4c427008b94c858a0ae0c052b3f504: ending tablet copy session 0f0ba89361b84f4fb67ea50baceb389a-31709d3af7ca4ec9aeff86d4b346ae05 on tablet 31709d3af7ca4ec9aeff86d4b346ae05 with peer 0f0ba89361b84f4fb67ea50baceb389a
I20260811 16:58:43.616542 17271 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:43.628624 17390 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:43.637776 17521 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:43.792851 17288 raft_consensus.cc:1203] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3] Dedup: 1.3->[]
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c15cf5f3ac0b47e6851ccb7da9d47ed8 | 127.10.149.126:36011 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
0f0ba89361b84f4fb67ea50baceb389a | 127.10.149.65:38033 | HEALTHY | <none> | 0 | 0
3e4c427008b94c858a0ae0c052b3f504 | 127.10.149.67:36859 | HEALTHY | <none> | 1 | 0
846b42a17c1b42cf899551700d99d495 | 127.10.149.66:34541 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 31709d3af7ca4ec9aeff86d4b346ae05 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
846b42a17c1b42cf899551700d99d495 (127.10.149.66:34541): RUNNING
3e4c427008b94c858a0ae0c052b3f504 (127.10.149.67:36859): RUNNING [LEADER]
0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): RUNNING
All reported replicas are:
A = 846b42a17c1b42cf899551700d99d495
B = 3e4c427008b94c858a0ae0c052b3f504
C = 0f0ba89361b84f4fb67ea50baceb389a
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | 3 | Yes
B | A B* C | 1 | 3 | Yes
C | A B C | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:43.851187 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:44.410518 17271 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:44.419752 17521 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:44.420351 17390 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c15cf5f3ac0b47e6851ccb7da9d47ed8 | 127.10.149.126:36011 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
0f0ba89361b84f4fb67ea50baceb389a | 127.10.149.65:38033 | HEALTHY | <none> | 0 | 0
3e4c427008b94c858a0ae0c052b3f504 | 127.10.149.67:36859 | HEALTHY | <none> | 1 | 0
846b42a17c1b42cf899551700d99d495 | 127.10.149.66:34541 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260811 16:58:44.651880 10837 log_verifier.cc:126] Checking tablet 31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:44.738544 10837 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 31709d3af7ca4ec9aeff86d4b346ae05
I20260811 16:58:44.743224 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:44.784693 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:44.785856 10837 tablet_replica.cc:330] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a: stopping tablet replica
I20260811 16:58:44.786741 10837 raft_consensus.cc:2229] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:44.787629 10837 raft_consensus.cc:2258] T 31709d3af7ca4ec9aeff86d4b346ae05 P 0f0ba89361b84f4fb67ea50baceb389a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:58:44.808862 17484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.149.65:38033: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260811 16:58:44.815135 17484 consensus_peers.cc:487] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 -> Peer 0f0ba89361b84f4fb67ea50baceb389a (127.10.149.65:38033): Couldn't send request to peer 0f0ba89361b84f4fb67ea50baceb389a. Status: Network error: Client connection negotiation failed: client connection to 127.10.149.65:38033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:44.815593 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:44.831027 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:58:44.869725 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:44.870580 10837 tablet_replica.cc:330] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495: stopping tablet replica
I20260811 16:58:44.871400 10837 raft_consensus.cc:2229] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:44.872298 10837 raft_consensus.cc:2258] T 31709d3af7ca4ec9aeff86d4b346ae05 P 846b42a17c1b42cf899551700d99d495 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:44.900067 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:58:44.915666 10837 tablet_server.cc:178] TabletServer@127.10.149.67:0 shutting down...
I20260811 16:58:44.945472 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:44.946199 10837 tablet_replica.cc:330] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504: stopping tablet replica
I20260811 16:58:44.946810 10837 raft_consensus.cc:2229] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:44.947897 10837 raft_consensus.cc:2258] T 31709d3af7ca4ec9aeff86d4b346ae05 P 3e4c427008b94c858a0ae0c052b3f504 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:44.970299 10837 tablet_server.cc:194] TabletServer@127.10.149.67:0 shutdown complete.
I20260811 16:58:44.982661 10837 master.cc:537] Master@127.10.149.126:36011 shutting down...
I20260811 16:58:45.006294 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:45.007105 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:45.007629 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P c15cf5f3ac0b47e6851ccb7da9d47ed8: stopping tablet replica
I20260811 16:58:45.027253 10837 master.cc:552] Master@127.10.149.126:36011 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/0 (5046 ms)
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/1
I20260811 16:58:45.063445 10837 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.149.126:32893
I20260811 16:58:45.064690 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:45.071635 17900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.072274 17901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.073813 17903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.075392 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:45.076187 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:45.076357 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:45.076567 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467525076553 us; error 0 us; skew 500 ppm
I20260811 16:58:45.077186 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:45.080395 10837 webserver.cc:460] Webserver started at http://127.10.149.126:46395/ using document root <none> and password file <none>
I20260811 16:58:45.080986 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:45.081146 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:45.081648 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:45.082948 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/master-0-root/instance:
uuid: "b1ac0ea9c5554ef183fb431c03067ef3"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.089329 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 16:58:45.093597 17912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.094462 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 16:58:45.094828 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/master-0-root
uuid: "b1ac0ea9c5554ef183fb431c03067ef3"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.095142 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:45.134337 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:45.135871 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:45.182156 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.126:32893
I20260811 16:58:45.182301 17994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.126:32893 every 8 connection(s)
I20260811 16:58:45.186779 17995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:45.202212 17995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3: Bootstrap starting.
I20260811 16:58:45.208060 17995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:45.213058 17995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3: No bootstrap required, opened a new log
I20260811 16:58:45.215462 17995 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER }
I20260811 16:58:45.216012 17995 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:45.216195 17995 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1ac0ea9c5554ef183fb431c03067ef3, State: Initialized, Role: FOLLOWER
I20260811 16:58:45.216758 17995 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER }
I20260811 16:58:45.217188 17995 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:58:45.217418 17995 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:58:45.217638 17995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:45.222930 17995 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER }
I20260811 16:58:45.223979 17995 leader_election.cc:302] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1ac0ea9c5554ef183fb431c03067ef3; no voters:
I20260811 16:58:45.225734 17995 leader_election.cc:288] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:58:45.226079 17998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:45.227797 17998 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 1 LEADER]: Becoming Leader. State: Replica: b1ac0ea9c5554ef183fb431c03067ef3, State: Running, Role: LEADER
I20260811 16:58:45.228708 17998 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER }
I20260811 16:58:45.230789 17995 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:58:45.234807 17999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER } }
I20260811 16:58:45.235530 17999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:45.234783 18000 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1ac0ea9c5554ef183fb431c03067ef3. Latest consensus state: current_term: 1 leader_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1ac0ea9c5554ef183fb431c03067ef3" member_type: VOTER } }
I20260811 16:58:45.237939 18000 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:58:45.239573 18005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:58:45.248183 18005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:58:45.249439 10837 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:58:45.258657 18005 catalog_manager.cc:1347] Generated new cluster ID: 6faa8d5525c8449c88bd04861c7e611b
I20260811 16:58:45.258988 18005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:58:45.283967 18005 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:58:45.291199 18005 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:58:45.306041 18005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3: Generated new TSK 0
I20260811 16:58:45.307261 18005 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:58:45.317240 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:45.324555 18020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.326556 18024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.329988 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:45.328486 18031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.332221 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:45.332456 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:45.332643 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467525332629 us; error 0 us; skew 500 ppm
I20260811 16:58:45.333272 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:45.336074 10837 webserver.cc:460] Webserver started at http://127.10.149.65:44065/ using document root <none> and password file <none>
I20260811 16:58:45.336619 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:45.336778 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:45.337225 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:45.338754 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-0-root/instance:
uuid: "fb91f105cb0b4f8f94677e84d16b995f"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.344337 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 16:58:45.348539 18038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.350451 10837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 16:58:45.351064 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-0-root
uuid: "fb91f105cb0b4f8f94677e84d16b995f"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.351480 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:45.381574 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:45.383136 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:45.384784 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:45.387341 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:45.387569 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.387872 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:45.388036 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.445196 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.65:35175
I20260811 16:58:45.445366 18141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.65:35175 every 8 connection(s)
I20260811 16:58:45.451303 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:45.460698 18150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.462103 18151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.466089 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:45.468421 18154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.469722 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:45.470124 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:45.470346 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467525470328 us; error 0 us; skew 500 ppm
I20260811 16:58:45.471007 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:45.471434 18142 heartbeater.cc:347] Connected to a master server at 127.10.149.126:32893
I20260811 16:58:45.471884 18142 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:45.473163 18142 heartbeater.cc:511] Master 127.10.149.126:32893 requested a full tablet report, sending...
I20260811 16:58:45.474692 10837 webserver.cc:460] Webserver started at http://127.10.149.66:35637/ using document root <none> and password file <none>
I20260811 16:58:45.475427 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:45.475679 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:45.476034 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:45.475927 17944 ts_manager.cc:194] Registered new tserver with Master: fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65:35175)
I20260811 16:58:45.477843 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-1-root/instance:
uuid: "d966a1a83c214a61a5cfb4d6e59a8914"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.479099 17944 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47280
I20260811 16:58:45.484393 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 16:58:45.488541 18163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.489591 10837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 16:58:45.489876 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-1-root
uuid: "d966a1a83c214a61a5cfb4d6e59a8914"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.490180 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:45.507174 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:45.508458 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:45.510198 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:45.512638 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:45.512816 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.513119 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:45.513268 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.566709 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.66:39151
I20260811 16:58:45.567032 18259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.66:39151 every 8 connection(s)
I20260811 16:58:45.572127 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:45.579774 18264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.582542 18267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.584246 10837 server_base.cc:1034] running on GCE node
W20260811 16:58:45.586407 18269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.587666 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:45.587956 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:45.588176 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467525588159 us; error 0 us; skew 500 ppm
I20260811 16:58:45.588930 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:45.588985 18260 heartbeater.cc:347] Connected to a master server at 127.10.149.126:32893
I20260811 16:58:45.589494 18260 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:45.590390 18260 heartbeater.cc:511] Master 127.10.149.126:32893 requested a full tablet report, sending...
I20260811 16:58:45.592104 10837 webserver.cc:460] Webserver started at http://127.10.149.67:44767/ using document root <none> and password file <none>
I20260811 16:58:45.592720 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:45.593000 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:45.593026 17944 ts_manager.cc:194] Registered new tserver with Master: d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151)
I20260811 16:58:45.593393 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:45.594601 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root/instance:
uuid: "b76ff69e3ecc46c7b12bc556c8821284"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.594952 17944 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47284
I20260811 16:58:45.599844 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 16:58:45.604725 18275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.605988 10837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 16:58:45.606384 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root
uuid: "b76ff69e3ecc46c7b12bc556c8821284"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.606724 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:45.617743 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:45.619051 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:45.620713 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:45.623162 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:45.623400 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.623648 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:45.623827 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.675040 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.67:33279
I20260811 16:58:45.675177 18383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.67:33279 every 8 connection(s)
I20260811 16:58:45.680419 10837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:58:45.689711 18391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.690634 18394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:58:45.695173 18397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:58:45.696216 10837 server_base.cc:1034] running on GCE node
I20260811 16:58:45.697432 10837 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:58:45.697681 10837 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:58:45.697877 10837 hybrid_clock.cc:648] HybridClock initialized: now 1786467525697860 us; error 0 us; skew 500 ppm
I20260811 16:58:45.698267 18386 heartbeater.cc:347] Connected to a master server at 127.10.149.126:32893
I20260811 16:58:45.698650 10837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:58:45.698693 18386 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:45.699883 18386 heartbeater.cc:511] Master 127.10.149.126:32893 requested a full tablet report, sending...
I20260811 16:58:45.702265 10837 webserver.cc:460] Webserver started at http://127.10.149.68:34101/ using document root <none> and password file <none>
I20260811 16:58:45.702558 17944 ts_manager.cc:194] Registered new tserver with Master: b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279)
I20260811 16:58:45.702790 10837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:58:45.703092 10837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:58:45.703357 10837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:58:45.704571 17944 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47298
I20260811 16:58:45.704679 10837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-3-root/instance:
uuid: "18dc95f371a84ff099fd6ebfc9584a4e"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.710863 10837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 16:58:45.714666 18407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.715549 10837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 16:58:45.715883 10837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-3-root
uuid: "18dc95f371a84ff099fd6ebfc9584a4e"
format_stamp: "Formatted at 2026-08-11 16:58:45 on dist-test-slave-j2vl"
I20260811 16:58:45.716176 10837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:58:45.755241 10837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:58:45.756616 10837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:58:45.758013 10837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:58:45.760227 10837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:58:45.760454 10837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.760712 10837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:58:45.760914 10837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:58:45.806789 10837 rpc_server.cc:307] RPC server started. Bound to: 127.10.149.68:41169
I20260811 16:58:45.806924 18502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.149.68:41169 every 8 connection(s)
I20260811 16:58:45.826179 18504 heartbeater.cc:347] Connected to a master server at 127.10.149.126:32893
I20260811 16:58:45.826602 18504 heartbeater.cc:464] Registering TS with master...
I20260811 16:58:45.827349 18504 heartbeater.cc:511] Master 127.10.149.126:32893 requested a full tablet report, sending...
I20260811 16:58:45.829797 17944 ts_manager.cc:194] Registered new tserver with Master: 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68:41169)
I20260811 16:58:45.830816 10837 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01991545s
I20260811 16:58:45.831661 17944 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47306
I20260811 16:58:45.856393 10837 test_util.cc:268] Using random seed: 1648888945
I20260811 16:58:45.884851 17944 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47336:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:58:45.959758 18205 tablet_service.cc:1467] Processing CreateTablet for tablet f4a1a1e2972f4d47a2b5043a733939e8 (DEFAULT_TABLE table=test-workload [id=55591b8a45654a54a6496483b4c94a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:45.961331 18205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a1a1e2972f4d47a2b5043a733939e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:45.964180 18333 tablet_service.cc:1467] Processing CreateTablet for tablet f4a1a1e2972f4d47a2b5043a733939e8 (DEFAULT_TABLE table=test-workload [id=55591b8a45654a54a6496483b4c94a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:45.965734 18085 tablet_service.cc:1467] Processing CreateTablet for tablet f4a1a1e2972f4d47a2b5043a733939e8 (DEFAULT_TABLE table=test-workload [id=55591b8a45654a54a6496483b4c94a96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:58:45.966125 18333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a1a1e2972f4d47a2b5043a733939e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:45.966971 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a1a1e2972f4d47a2b5043a733939e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:45.983979 18552 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: Bootstrap starting.
I20260811 16:58:45.985786 18551 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: Bootstrap starting.
I20260811 16:58:45.988057 18553 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Bootstrap starting.
I20260811 16:58:45.991899 18552 tablet_bootstrap.cc:654] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:45.993562 18553 tablet_bootstrap.cc:654] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:45.993705 18551 tablet_bootstrap.cc:654] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: Neither blocks nor log segments found. Creating new log.
I20260811 16:58:46.000922 18551 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: No bootstrap required, opened a new log
I20260811 16:58:46.001513 18551 ts_tablet_manager.cc:1397] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
I20260811 16:58:46.001597 18553 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: No bootstrap required, opened a new log
I20260811 16:58:46.002146 18553 ts_tablet_manager.cc:1397] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.008s
I20260811 16:58:46.002733 18552 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: No bootstrap required, opened a new log
I20260811 16:58:46.003219 18552 ts_tablet_manager.cc:1397] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.010s
I20260811 16:58:46.004925 18553 raft_consensus.cc:348] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.004904 18551 raft_consensus.cc:348] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.006053 18553 raft_consensus.cc:374] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:46.006170 18551 raft_consensus.cc:374] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:46.006433 18553 raft_consensus.cc:729] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b76ff69e3ecc46c7b12bc556c8821284, State: Initialized, Role: FOLLOWER
I20260811 16:58:46.006640 18551 raft_consensus.cc:729] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d966a1a83c214a61a5cfb4d6e59a8914, State: Initialized, Role: FOLLOWER
I20260811 16:58:46.006536 18552 raft_consensus.cc:348] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.007731 18553 consensus_queue.cc:260] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.007688 18551 consensus_queue.cc:260] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.011348 18553 ts_tablet_manager.cc:1428] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Time spent starting tablet: real 0.009s user 0.002s sys 0.006s
I20260811 16:58:46.011314 18386 heartbeater.cc:503] Master 127.10.149.126:32893 was elected leader, sending a full tablet report...
I20260811 16:58:46.008430 18552 raft_consensus.cc:374] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:58:46.014254 18552 raft_consensus.cc:729] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb91f105cb0b4f8f94677e84d16b995f, State: Initialized, Role: FOLLOWER
I20260811 16:58:46.014772 18260 heartbeater.cc:503] Master 127.10.149.126:32893 was elected leader, sending a full tablet report...
I20260811 16:58:46.015237 18552 consensus_queue.cc:260] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.016479 18551 ts_tablet_manager.cc:1428] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260811 16:58:46.019948 18142 heartbeater.cc:503] Master 127.10.149.126:32893 was elected leader, sending a full tablet report...
I20260811 16:58:46.020713 18552 ts_tablet_manager.cc:1428] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: Time spent starting tablet: real 0.017s user 0.005s sys 0.008s
I20260811 16:58:46.036120 18569 raft_consensus.cc:482] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:58:46.036698 18569 raft_consensus.cc:504] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.039044 18569 leader_election.cc:288] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151), b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279)
I20260811 16:58:46.058104 18345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a1a1e2972f4d47a2b5043a733939e8" candidate_uuid: "fb91f105cb0b4f8f94677e84d16b995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b76ff69e3ecc46c7b12bc556c8821284" is_pre_election: true
I20260811 16:58:46.058143 18222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a1a1e2972f4d47a2b5043a733939e8" candidate_uuid: "fb91f105cb0b4f8f94677e84d16b995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" is_pre_election: true
I20260811 16:58:46.059252 18222 raft_consensus.cc:2454] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb91f105cb0b4f8f94677e84d16b995f in term 0.
I20260811 16:58:46.059217 18345 raft_consensus.cc:2454] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb91f105cb0b4f8f94677e84d16b995f in term 0.
I20260811 16:58:46.060766 18040 leader_election.cc:302] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d966a1a83c214a61a5cfb4d6e59a8914, fb91f105cb0b4f8f94677e84d16b995f; no voters:
I20260811 16:58:46.061759 18569 raft_consensus.cc:2781] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:58:46.062106 18569 raft_consensus.cc:482] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:58:46.062402 18569 raft_consensus.cc:3037] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:46.067530 18569 raft_consensus.cc:504] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.069208 18569 leader_election.cc:288] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [CANDIDATE]: Term 1 election: Requested vote from peers d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151), b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279)
I20260811 16:58:46.070393 18222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a1a1e2972f4d47a2b5043a733939e8" candidate_uuid: "fb91f105cb0b4f8f94677e84d16b995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d966a1a83c214a61a5cfb4d6e59a8914"
I20260811 16:58:46.070466 18345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a1a1e2972f4d47a2b5043a733939e8" candidate_uuid: "fb91f105cb0b4f8f94677e84d16b995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b76ff69e3ecc46c7b12bc556c8821284"
I20260811 16:58:46.071157 18345 raft_consensus.cc:3037] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:46.071128 18222 raft_consensus.cc:3037] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:58:46.076998 18222 raft_consensus.cc:2454] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb91f105cb0b4f8f94677e84d16b995f in term 1.
I20260811 16:58:46.077047 18345 raft_consensus.cc:2454] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb91f105cb0b4f8f94677e84d16b995f in term 1.
I20260811 16:58:46.078308 18040 leader_election.cc:302] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d966a1a83c214a61a5cfb4d6e59a8914, fb91f105cb0b4f8f94677e84d16b995f; no voters:
I20260811 16:58:46.079130 18569 raft_consensus.cc:2781] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:58:46.080345 18569 raft_consensus.cc:686] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 LEADER]: Becoming Leader. State: Replica: fb91f105cb0b4f8f94677e84d16b995f, State: Running, Role: LEADER
I20260811 16:58:46.081204 18569 consensus_queue.cc:237] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:46.089627 17943 catalog_manager.cc:5495] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f reported cstate change: term changed from 0 to 1, leader changed from <none> to fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65). New cstate: current_term: 1 leader_uuid: "fb91f105cb0b4f8f94677e84d16b995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260811 16:58:46.379909 18452 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:46.381753 18333 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:46.386929 18205 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:46.401786 18085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:46.470913 18569 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:58:46.517661 18572 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b76ff69e3ecc46c7b12bc556c8821284" member_type: VOTER last_known_addr { host: "127.10.149.67" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
b1ac0ea9c5554ef183fb431c03067ef3 | 127.10.149.126:32893 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | HEALTHY | <none> | 0 | 0
b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | HEALTHY | <none> | 0 | 0
d966a1a83c214a61a5cfb4d6e59a8914 | 127.10.149.66:39151 | HEALTHY | <none> | 0 | 0
fb91f105cb0b4f8f94677e84d16b995f | 127.10.149.65:35175 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f4a1a1e2972f4d47a2b5043a733939e8 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151): RUNNING
b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279): RUNNING
fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65:35175): RUNNING [LEADER]
All reported replicas are:
A = d966a1a83c214a61a5cfb4d6e59a8914
B = b76ff69e3ecc46c7b12bc556c8821284
C = fb91f105cb0b4f8f94677e84d16b995f
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C | 1 | -1 | Yes
B | A B C | 1 | -1 | Yes
C | A B C* | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+---------------------+---------------
Small | 18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:46.714965 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:46.835255 18504 heartbeater.cc:503] Master 127.10.149.126:32893 was elected leader, sending a full tablet report...
I20260811 16:58:47.138024 18452 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:47.148581 18333 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:47.150849 18085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:47.154770 18205 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
b1ac0ea9c5554ef183fb431c03067ef3 | 127.10.149.126:32893 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | HEALTHY | <none> | 0 | 0
b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | HEALTHY | <none> | 0 | 0
d966a1a83c214a61a5cfb4d6e59a8914 | 127.10.149.66:39151 | HEALTHY | <none> | 0 | 0
fb91f105cb0b4f8f94677e84d16b995f | 127.10.149.65:35175 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+---------------------+---------------
Small | 18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260811 16:58:47.412304 10837 log_verifier.cc:126] Checking tablet f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:47.475541 10837 log_verifier.cc:177] Verified matching terms for 1 ops in tablet f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:47.476166 10837 tablet_replica.cc:330] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: stopping tablet replica
I20260811 16:58:47.476773 10837 raft_consensus.cc:2229] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:47.477267 10837 raft_consensus.cc:2258] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:47.676967 18044 consensus_queue.cc:579] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: The tablet replica hosted on peer b76ff69e3ecc46c7b12bc556c8821284 has failed
W20260811 16:58:47.677708 18044 consensus_peers.cc:487] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f -> Peer b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279): Couldn't send request to peer b76ff69e3ecc46c7b12bc556c8821284. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:58:47.687799 18104 consensus_queue.cc:237] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } }
I20260811 16:58:47.693614 18222 raft_consensus.cc:1261] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Refusing update from remote peer fb91f105cb0b4f8f94677e84d16b995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:58:47.695349 18680 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:58:47.705061 18715 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } }
I20260811 16:58:47.706651 18222 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } }
I20260811 16:58:47.717104 17914 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f4a1a1e2972f4d47a2b5043a733939e8 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:58:47.722157 17939 catalog_manager.cc:5495] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 reported cstate change: config changed from index -1 to 2, VOTER b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67) evicted. New cstate: current_term: 1 leader_uuid: "fb91f105cb0b4f8f94677e84d16b995f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } }
I20260811 16:58:47.783164 18333 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a1a1e2972f4d47a2b5043a733939e8 with delete_type TABLET_DATA_TOMBSTONED (TS b76ff69e3ecc46c7b12bc556c8821284 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:45858
I20260811 16:58:47.790234 18104 consensus_queue.cc:237] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } }
I20260811 16:58:47.799906 18452 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:47.805150 18330 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:47.812510 18752 ts_tablet_manager.cc:1905] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:58:47.813717 18085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:47.817085 18205 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:47.820540 18222 raft_consensus.cc:1261] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Refusing update from remote peer fb91f105cb0b4f8f94677e84d16b995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:58:47.823887 18715 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:58:47.835491 18680 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } } }
I20260811 16:58:47.844157 18752 ts_tablet_manager.cc:1918] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260811 16:58:47.844749 18752 log.cc:1196] T f4a1a1e2972f4d47a2b5043a733939e8 P b76ff69e3ecc46c7b12bc556c8821284: Deleting WAL directory at /tmp/dist-test-taskDx92Zd/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786467463543483-10837-0/minicluster-data/ts-2-root/wals/f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:47.847628 17916 catalog_manager.cc:4841] TS b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279): tablet f4a1a1e2972f4d47a2b5043a733939e8 (table test-workload [id=55591b8a45654a54a6496483b4c94a96]) successfully deleted
I20260811 16:58:47.848031 18218 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } } }
I20260811 16:58:47.851389 17914 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f4a1a1e2972f4d47a2b5043a733939e8 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260811 16:58:47.857913 17936 catalog_manager.cc:5495] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f reported cstate change: config changed from index 2 to 3, NON_VOTER 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) added. New cstate: current_term: 1 leader_uuid: "fb91f105cb0b4f8f94677e84d16b995f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:58:47.862363 18044 consensus_peers.cc:487] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f -> Peer 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68:41169): Couldn't send request to peer 18dc95f371a84ff099fd6ebfc9584a4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4a1a1e2972f4d47a2b5043a733939e8. This is attempt 1: this message will repeat every 5th retry.
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
b1ac0ea9c5554ef183fb431c03067ef3 | 127.10.149.126:32893 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | HEALTHY | <none> | 0 | 0
b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | HEALTHY | <none> | 0 | 0
d966a1a83c214a61a5cfb4d6e59a8914 | 127.10.149.66:39151 | HEALTHY | <none> | 0 | 0
fb91f105cb0b4f8f94677e84d16b995f | 127.10.149.65:35175 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f4a1a1e2972f4d47a2b5043a733939e8 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151): RUNNING
b76ff69e3ecc46c7b12bc556c8821284 (127.10.149.67:33279): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65:35175): RUNNING [LEADER]
All reported replicas are:
A = d966a1a83c214a61a5cfb4d6e59a8914
B = b76ff69e3ecc46c7b12bc556c8821284
C = fb91f105cb0b4f8f94677e84d16b995f
D = 18dc95f371a84ff099fd6ebfc9584a4e
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A C* | 1 | 2 | Yes
B | [config not available] | | |
C | A C* D~ | 1 | 3 | No
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+---------------------+---------------
Small | 18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:48.088658 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:48.424525 18790 ts_tablet_manager.cc:927] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Initiating tablet copy from peer fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65:35175)
I20260811 16:58:48.426051 18790 tablet_copy_client.cc:316] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: tablet copy: Beginning tablet copy session from remote peer at address 127.10.149.65:35175
I20260811 16:58:48.441421 18119 tablet_copy_service.cc:140] P fb91f105cb0b4f8f94677e84d16b995f: Received BeginTabletCopySession request for tablet f4a1a1e2972f4d47a2b5043a733939e8 from peer 18dc95f371a84ff099fd6ebfc9584a4e ({username='slave'} at 127.0.0.1:36788)
I20260811 16:58:48.442068 18119 tablet_copy_service.cc:161] P fb91f105cb0b4f8f94677e84d16b995f: Beginning new tablet copy session on tablet f4a1a1e2972f4d47a2b5043a733939e8 from peer 18dc95f371a84ff099fd6ebfc9584a4e at {username='slave'} at 127.0.0.1:36788: session id = 18dc95f371a84ff099fd6ebfc9584a4e-f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:48.448662 18119 tablet_copy_source_session.cc:205] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:58:48.452683 18790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a1a1e2972f4d47a2b5043a733939e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:58:48.478492 18790 tablet_copy_client.cc:791] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: tablet copy: Starting download of 0 data blocks...
I20260811 16:58:48.479351 18790 tablet_copy_client.cc:655] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: tablet copy: Starting download of 1 WAL segments...
I20260811 16:58:48.486696 18790 tablet_copy_client.cc:531] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:58:48.490815 18452 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:48.501943 18790 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Bootstrap starting.
I20260811 16:58:48.511379 18333 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:48.526993 18205 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:48.534528 18085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:48.549302 18790 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:58:48.550376 18790 tablet_bootstrap.cc:492] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Bootstrap complete.
I20260811 16:58:48.551117 18790 ts_tablet_manager.cc:1397] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Time spent bootstrapping tablet: real 0.049s user 0.037s sys 0.004s
I20260811 16:58:48.554598 18790 raft_consensus.cc:348] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } }
I20260811 16:58:48.555599 18790 raft_consensus.cc:729] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 18dc95f371a84ff099fd6ebfc9584a4e, State: Initialized, Role: LEARNER
I20260811 16:58:48.556255 18790 consensus_queue.cc:260] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: NON_VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: true } }
I20260811 16:58:48.559971 18790 ts_tablet_manager.cc:1428] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 16:58:48.565448 18119 tablet_copy_service.cc:342] P fb91f105cb0b4f8f94677e84d16b995f: Request end of tablet copy session 18dc95f371a84ff099fd6ebfc9584a4e-f4a1a1e2972f4d47a2b5043a733939e8 received from {username='slave'} at 127.0.0.1:36788
I20260811 16:58:48.565917 18119 tablet_copy_service.cc:433] P fb91f105cb0b4f8f94677e84d16b995f: ending tablet copy session 18dc95f371a84ff099fd6ebfc9584a4e-f4a1a1e2972f4d47a2b5043a733939e8 on tablet f4a1a1e2972f4d47a2b5043a733939e8 with peer 18dc95f371a84ff099fd6ebfc9584a4e
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
b1ac0ea9c5554ef183fb431c03067ef3 | 127.10.149.126:32893 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | HEALTHY | <none> | 0 | 0
b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | HEALTHY | <none> | 0 | 0
d966a1a83c214a61a5cfb4d6e59a8914 | 127.10.149.66:39151 | HEALTHY | <none> | 0 | 0
fb91f105cb0b4f8f94677e84d16b995f | 127.10.149.65:35175 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet f4a1a1e2972f4d47a2b5043a733939e8 of table 'test-workload' is recovering: 1 on-going tablet copies
d966a1a83c214a61a5cfb4d6e59a8914 (127.10.149.66:39151): RUNNING
fb91f105cb0b4f8f94677e84d16b995f (127.10.149.65:35175): RUNNING [LEADER]
18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68:41169): not running [NONVOTER]
State: INITIALIZED
Data state: TABLET_DATA_COPYING
Last status: Tablet Copy: Downloading WAL segment with seq. number 1 (1/1)
All reported replicas are:
A = d966a1a83c214a61a5cfb4d6e59a8914
B = fb91f105cb0b4f8f94677e84d16b995f
C = 18dc95f371a84ff099fd6ebfc9584a4e
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C~ | | | Yes
A | A B* C~ | 1 | 3 | Yes
B | A B* C~ | 1 | 3 | Yes
C | A B C~ | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | RECOVERING | 1 | 0 | 1 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+---------------------+---------------
Small | b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260811 16:58:48.771118 10837 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260811 16:58:48.966357 18467 raft_consensus.cc:1203] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3] Dedup: 1.3->[]
I20260811 16:58:49.249518 18452 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:49.254748 18205 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260811 16:58:49.255069 18085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260811 16:58:49.256963 18333 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
b1ac0ea9c5554ef183fb431c03067ef3 | 127.10.149.126:32893 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
18dc95f371a84ff099fd6ebfc9584a4e | 127.10.149.68:41169 | HEALTHY | <none> | 0 | 0
b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | HEALTHY | <none> | 0 | 0
d966a1a83c214a61a5cfb4d6e59a8914 | 127.10.149.66:39151 | HEALTHY | <none> | 0 | 0
fb91f105cb0b4f8f94677e84d16b995f | 127.10.149.65:35175 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+---------------------+---------------
Small | b76ff69e3ecc46c7b12bc556c8821284 | 127.10.149.67:33279 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260811 16:58:49.516875 10837 log_verifier.cc:126] Checking tablet f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:49.527335 18680 raft_consensus.cc:1050] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: attempting to promote NON_VOTER 18dc95f371a84ff099fd6ebfc9584a4e to VOTER
I20260811 16:58:49.530035 18680 consensus_queue.cc:237] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false } }
I20260811 16:58:49.538420 18467 raft_consensus.cc:1261] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 LEARNER]: Refusing update from remote peer fb91f105cb0b4f8f94677e84d16b995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:58:49.538456 18218 raft_consensus.cc:1261] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Refusing update from remote peer fb91f105cb0b4f8f94677e84d16b995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:58:49.540428 18872 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:58:49.541836 18680 consensus_queue.cc:1035] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:58:49.549877 18872 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false } } }
I20260811 16:58:49.551806 18218 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false } } }
I20260811 16:58:49.569552 17936 catalog_manager.cc:5495] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f reported cstate change: config changed from index 3 to 4, 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fb91f105cb0b4f8f94677e84d16b995f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:58:49.577451 18467 raft_consensus.cc:2932] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, 18dc95f371a84ff099fd6ebfc9584a4e (127.10.149.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d966a1a83c214a61a5cfb4d6e59a8914" member_type: VOTER last_known_addr { host: "127.10.149.66" port: 39151 } } peers { permanent_uuid: "fb91f105cb0b4f8f94677e84d16b995f" member_type: VOTER last_known_addr { host: "127.10.149.65" port: 35175 } } peers { permanent_uuid: "18dc95f371a84ff099fd6ebfc9584a4e" member_type: VOTER last_known_addr { host: "127.10.149.68" port: 41169 } attrs { promote: false } } }
I20260811 16:58:49.623602 10837 log_verifier.cc:177] Verified matching terms for 4 ops in tablet f4a1a1e2972f4d47a2b5043a733939e8
I20260811 16:58:49.625831 10837 tablet_server.cc:178] TabletServer@127.10.149.65:0 shutting down...
I20260811 16:58:49.649497 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:49.650226 10837 tablet_replica.cc:330] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f: stopping tablet replica
I20260811 16:58:49.650727 10837 raft_consensus.cc:2229] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:49.651502 10837 raft_consensus.cc:2258] T f4a1a1e2972f4d47a2b5043a733939e8 P fb91f105cb0b4f8f94677e84d16b995f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:49.662701 10837 tablet_server.cc:194] TabletServer@127.10.149.65:0 shutdown complete.
I20260811 16:58:49.672132 10837 tablet_server.cc:178] TabletServer@127.10.149.66:0 shutting down...
I20260811 16:58:49.695206 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:49.695873 10837 tablet_replica.cc:330] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914: stopping tablet replica
I20260811 16:58:49.696427 10837 raft_consensus.cc:2229] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:49.696966 10837 raft_consensus.cc:2258] T f4a1a1e2972f4d47a2b5043a733939e8 P d966a1a83c214a61a5cfb4d6e59a8914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:49.717250 10837 tablet_server.cc:194] TabletServer@127.10.149.66:0 shutdown complete.
I20260811 16:58:49.727298 10837 tablet_server.cc:178] TabletServer@127.10.149.67:0 shutting down...
I20260811 16:58:49.752085 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:49.769773 10837 tablet_server.cc:194] TabletServer@127.10.149.67:0 shutdown complete.
I20260811 16:58:49.779249 10837 tablet_server.cc:178] TabletServer@127.10.149.68:0 shutting down...
I20260811 16:58:49.799516 10837 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:58:49.800141 10837 tablet_replica.cc:330] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e: stopping tablet replica
I20260811 16:58:49.800659 10837 raft_consensus.cc:2229] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:58:49.801151 10837 raft_consensus.cc:2258] T f4a1a1e2972f4d47a2b5043a733939e8 P 18dc95f371a84ff099fd6ebfc9584a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:49.823211 10837 tablet_server.cc:194] TabletServer@127.10.149.68:0 shutdown complete.
I20260811 16:58:49.834640 10837 master.cc:537] Master@127.10.149.126:32893 shutting down...
I20260811 16:58:49.854501 10837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:58:49.855062 10837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:58:49.855329 10837 tablet_replica.cc:330] T 00000000000000000000000000000000 P b1ac0ea9c5554ef183fb431c03067ef3: stopping tablet replica
I20260811 16:58:49.875488 10837 master.cc:552] Master@127.10.149.126:32893 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4842 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (9889 ms total)
[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (66027 ms total)
[ PASSED ] 11 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[ FAILED ] 1 test, listed below:
[ FAILED ] TsTabletManagerITest.TestTableStats
1 FAILED TEST
I20260811 16:58:49.914615 10837 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~10 seconds ago
I20260811 16:58:49.914930 10837 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 64 messages since previous log ~57 seconds ago
I20260811 16:58:49.915189 10837 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 7 messages since previous log ~14 seconds ago