[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 17:59:41.719065 17557 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.151s user 0.397s sys 0.752s
W20260812 17:59:41.719576 17557 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.151s user 0.397s sys 0.752s
I20260812 17:59:41.723968 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:44901
I20260812 17:59:41.725906 17557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:59:41.727173 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:41.742947 17572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:41.744210 17573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:41.894317 17576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:41.894613 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:41.895829 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:41.896050 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:41.896191 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557581896177 us; error 0 us; skew 500 ppm
I20260812 17:59:41.896895 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:41.906740 17557 webserver.cc:460] Webserver started at http://127.17.37.126:35735/ using document root <none> and password file <none>
I20260812 17:59:41.907604 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:41.907765 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:41.908082 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:41.913381 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "71b7c3d298424063918ab6df990e407d"
format_stamp: "Formatted at 2026-08-12 17:59:41 on dist-test-slave-6nmv"
I20260812 17:59:41.920506 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 17:59:41.925220 17582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:41.926648 17557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:59:41.926963 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "71b7c3d298424063918ab6df990e407d"
format_stamp: "Formatted at 2026-08-12 17:59:41 on dist-test-slave-6nmv"
I20260812 17:59:41.927269 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:41.954206 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:41.955705 17557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:59:41.956158 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:42.022776 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:44901
I20260812 17:59:42.022847 17638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:44901 every 8 connection(s)
I20260812 17:59:42.028896 17639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:42.049688 17639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: Bootstrap starting.
I20260812 17:59:42.055436 17639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:42.057169 17639 log.cc:824] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:59:42.061313 17639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: No bootstrap required, opened a new log
I20260812 17:59:42.082652 17639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER }
I20260812 17:59:42.083274 17639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:42.083554 17639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b7c3d298424063918ab6df990e407d, State: Initialized, Role: FOLLOWER
I20260812 17:59:42.084362 17639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER }
I20260812 17:59:42.084841 17639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:59:42.085129 17639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:59:42.085491 17639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:42.089143 17639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER }
I20260812 17:59:42.089783 17639 leader_election.cc:302] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71b7c3d298424063918ab6df990e407d; no voters:
I20260812 17:59:42.091516 17639 leader_election.cc:288] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:59:42.091922 17642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:42.094012 17642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 1 LEADER]: Becoming Leader. State: Replica: 71b7c3d298424063918ab6df990e407d, State: Running, Role: LEADER
I20260812 17:59:42.094772 17642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER }
I20260812 17:59:42.095769 17639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:42.101679 17644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71b7c3d298424063918ab6df990e407d. Latest consensus state: current_term: 1 leader_uuid: "71b7c3d298424063918ab6df990e407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER } }
I20260812 17:59:42.101883 17643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71b7c3d298424063918ab6df990e407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71b7c3d298424063918ab6df990e407d" member_type: VOTER } }
I20260812 17:59:42.102388 17643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:42.102388 17644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:42.107717 17652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:42.119295 17652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:42.122195 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:42.136536 17652 catalog_manager.cc:1347] Generated new cluster ID: 47000c0a1fb240d4bbc849618123d7a5
I20260812 17:59:42.136780 17652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:42.155256 17652 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:42.157004 17652 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:42.169683 17652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: Generated new TSK 0
I20260812 17:59:42.170548 17652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:42.188263 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:42.196058 17669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:42.197414 17670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:42.200917 17672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:42.202332 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:42.203087 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:42.203303 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:42.203476 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557582203449 us; error 0 us; skew 500 ppm
I20260812 17:59:42.204041 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:42.208503 17557 webserver.cc:460] Webserver started at http://127.17.37.65:37097/ using document root <none> and password file <none>
I20260812 17:59:42.209178 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:42.209348 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:42.209589 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:42.211227 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "289fa0bce41d46d9a36c74a96c4ee46f"
format_stamp: "Formatted at 2026-08-12 17:59:42 on dist-test-slave-6nmv"
I20260812 17:59:42.217156 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 17:59:42.221416 17678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:42.222146 17557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:59:42.222365 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "289fa0bce41d46d9a36c74a96c4ee46f"
format_stamp: "Formatted at 2026-08-12 17:59:42 on dist-test-slave-6nmv"
I20260812 17:59:42.222617 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:42.242954 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:42.244060 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:42.246724 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:42.250859 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:42.251037 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:42.251204 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:42.251319 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:42.354769 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:43029
I20260812 17:59:42.354837 17752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:43029 every 8 connection(s)
I20260812 17:59:42.361239 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:42.370558 17759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:42.376490 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:42.385533 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:42.386116 17763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:42.387156 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:42.387460 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:42.387743 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557582387727 us; error 0 us; skew 500 ppm
I20260812 17:59:42.388268 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:42.390216 17753 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44901
I20260812 17:59:42.390645 17753 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:42.391724 17753 heartbeater.cc:511] Master 127.17.37.126:44901 requested a full tablet report, sending...
I20260812 17:59:42.391881 17557 webserver.cc:460] Webserver started at http://127.17.37.66:41079/ using document root <none> and password file <none>
I20260812 17:59:42.392472 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:42.392671 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:42.392972 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:42.394438 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "32118523b79b460fb9da5065225b3af1"
format_stamp: "Formatted at 2026-08-12 17:59:42 on dist-test-slave-6nmv"
I20260812 17:59:42.395256 17600 ts_manager.cc:194] Registered new tserver with Master: 289fa0bce41d46d9a36c74a96c4ee46f (127.17.37.65:43029)
I20260812 17:59:42.398422 17600 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59144
I20260812 17:59:42.402741 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260812 17:59:42.407635 17767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:42.408516 17557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 17:59:42.408818 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "32118523b79b460fb9da5065225b3af1"
format_stamp: "Formatted at 2026-08-12 17:59:42 on dist-test-slave-6nmv"
I20260812 17:59:42.409168 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:42.427048 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:42.428325 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:42.429888 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:42.433252 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:42.433429 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:42.433720 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:42.433931 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 17:59:42.502957 17753 heartbeater.cc:503] Master 127.17.37.126:44901 was elected leader, sending a full tablet report...
I20260812 17:59:42.539263 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:41999
I20260812 17:59:42.539405 17843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:41999 every 8 connection(s)
I20260812 17:59:42.559988 17844 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44901
I20260812 17:59:42.560444 17844 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:42.561143 17844 heartbeater.cc:511] Master 127.17.37.126:44901 requested a full tablet report, sending...
I20260812 17:59:42.562965 17600 ts_manager.cc:194] Registered new tserver with Master: 32118523b79b460fb9da5065225b3af1 (127.17.37.66:41999)
I20260812 17:59:42.563092 17557 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.018917833s
I20260812 17:59:42.564813 17600 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59156
I20260812 17:59:42.594568 17600 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59166:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:59:42.620643 17600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260812 17:59:42.668493 17844 heartbeater.cc:503] Master 127.17.37.126:44901 was elected leader, sending a full tablet report...
I20260812 17:59:42.672972 17715 tablet_service.cc:1467] Processing CreateTablet for tablet 4e17305d78dd41bb8a58496f33a75c9f (DEFAULT_TABLE table=test-table [id=fab68b52652745bf8de2e9e2b9c4499a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:42.674340 17715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e17305d78dd41bb8a58496f33a75c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:42.674273 17804 tablet_service.cc:1467] Processing CreateTablet for tablet 4e17305d78dd41bb8a58496f33a75c9f (DEFAULT_TABLE table=test-table [id=fab68b52652745bf8de2e9e2b9c4499a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:42.675184 17804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e17305d78dd41bb8a58496f33a75c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:42.677553 17802 tablet_service.cc:1467] Processing CreateTablet for tablet 868ad21f937c464aa042ed8480ff32c9 (DEFAULT_TABLE table=test-table [id=fab68b52652745bf8de2e9e2b9c4499a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:42.678750 17802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 868ad21f937c464aa042ed8480ff32c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:42.678956 17714 tablet_service.cc:1467] Processing CreateTablet for tablet 868ad21f937c464aa042ed8480ff32c9 (DEFAULT_TABLE table=test-table [id=fab68b52652745bf8de2e9e2b9c4499a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:42.680263 17714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 868ad21f937c464aa042ed8480ff32c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:42.694535 17861 tablet_bootstrap.cc:492] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: Bootstrap starting.
I20260812 17:59:42.699555 17862 tablet_bootstrap.cc:492] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: Bootstrap starting.
I20260812 17:59:42.704869 17861 tablet_bootstrap.cc:654] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:42.708870 17862 tablet_bootstrap.cc:654] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:42.711354 17861 tablet_bootstrap.cc:492] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: No bootstrap required, opened a new log
I20260812 17:59:42.712040 17861 ts_tablet_manager.cc:1397] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.009s
I20260812 17:59:42.715492 17861 raft_consensus.cc:348] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.716177 17861 raft_consensus.cc:729] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 289fa0bce41d46d9a36c74a96c4ee46f, State: Initialized, Role: FOLLOWER
I20260812 17:59:42.716760 17861 consensus_queue.cc:260] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.720109 17862 tablet_bootstrap.cc:492] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: No bootstrap required, opened a new log
I20260812 17:59:42.720479 17862 ts_tablet_manager.cc:1397] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.000s
I20260812 17:59:42.722196 17862 raft_consensus.cc:348] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.722703 17862 raft_consensus.cc:729] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Initialized, Role: FOLLOWER
I20260812 17:59:42.723204 17862 consensus_queue.cc:260] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.725659 17862 ts_tablet_manager.cc:1428] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 17:59:42.726538 17862 tablet_bootstrap.cc:492] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: Bootstrap starting.
I20260812 17:59:42.730698 17861 ts_tablet_manager.cc:1428] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: Time spent starting tablet: real 0.018s user 0.009s sys 0.008s
I20260812 17:59:42.734440 17861 tablet_bootstrap.cc:492] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: Bootstrap starting.
I20260812 17:59:42.739594 17861 tablet_bootstrap.cc:654] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:42.745424 17862 tablet_bootstrap.cc:654] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:42.752862 17862 tablet_bootstrap.cc:492] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: No bootstrap required, opened a new log
I20260812 17:59:42.753288 17862 ts_tablet_manager.cc:1397] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.004s
I20260812 17:59:42.755945 17862 raft_consensus.cc:348] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.756603 17862 raft_consensus.cc:729] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Initialized, Role: FOLLOWER
I20260812 17:59:42.757148 17862 consensus_queue.cc:260] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.759096 17862 ts_tablet_manager.cc:1428] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260812 17:59:42.762782 17861 tablet_bootstrap.cc:492] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: No bootstrap required, opened a new log
I20260812 17:59:42.763422 17861 ts_tablet_manager.cc:1397] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.005s
I20260812 17:59:42.766858 17861 raft_consensus.cc:348] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.767819 17861 raft_consensus.cc:729] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 289fa0bce41d46d9a36c74a96c4ee46f, State: Initialized, Role: FOLLOWER
I20260812 17:59:42.768607 17861 consensus_queue.cc:260] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.770987 17861 ts_tablet_manager.cc:1428] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 17:59:42.791556 17557 ts_tablet_manager-itest.cc:367] Electing peer 2...
I20260812 17:59:42.791894 17557 raft_consensus.cc:412] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Emulating election...
I20260812 17:59:42.792099 17557 raft_consensus.cc:3037] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Advancing to term 1
W20260812 17:59:42.794942 17845 tablet.cc:2369] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:59:42.796051 17557 raft_consensus.cc:686] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Becoming Leader. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:42.796720 17557 consensus_queue.cc:237] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:42.800449 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:42.807577 17599 catalog_manager.cc:5495] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32118523b79b460fb9da5065225b3af1 (127.17.37.66). New cstate: current_term: 1 leader_uuid: "32118523b79b460fb9da5065225b3af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: HEALTHY } } }
I20260812 17:59:42.827209 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:42.930603 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:43.134660 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:43.308689 17728 raft_consensus.cc:3037] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:43.315500 17866 consensus_queue.cc:1035] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 17:59:43.438310 17557 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260812 17:59:43.438587 17557 raft_consensus.cc:412] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Emulating election...
I20260812 17:59:43.438844 17557 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:43.443231 17557 raft_consensus.cc:686] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Becoming Leader. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:43.443735 17557 consensus_queue.cc:237] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:43.445616 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:43.449306 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:43.449193 17597 catalog_manager.cc:5495] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32118523b79b460fb9da5065225b3af1 (127.17.37.66). New cstate: current_term: 1 leader_uuid: "32118523b79b460fb9da5065225b3af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: HEALTHY } } }
I20260812 17:59:43.552953 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:43.756570 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:44.060047 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 0.0 1.1
I20260812 17:59:44.069458 17728 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:44.074446 17878 consensus_queue.cc:1035] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:44.663431 17557 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260812 17:59:44.663697 17557 raft_consensus.cc:412] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Emulating election...
I20260812 17:59:44.663908 17557 raft_consensus.cc:3032] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 17:59:44.664108 17557 raft_consensus.cc:729] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:44.664561 17557 consensus_queue.cc:260] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:44.665408 17557 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:44.669263 17557 raft_consensus.cc:686] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 2 LEADER]: Becoming Leader. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:44.669866 17557 consensus_queue.cc:237] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:44.671240 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:44.674803 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260812 17:59:44.674602 17597 catalog_manager.cc:5495] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "32118523b79b460fb9da5065225b3af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: HEALTHY } } }
I20260812 17:59:44.778113 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260812 17:59:44.981633 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 1.1 2.2
I20260812 17:59:45.198367 17728 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:45.203370 17728 raft_consensus.cc:1261] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 FOLLOWER]: Refusing update from remote peer 32118523b79b460fb9da5065225b3af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 17:59:45.204344 17878 consensus_queue.cc:1035] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:45.285198 17557 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260812 17:59:45.285416 17557 raft_consensus.cc:412] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 FOLLOWER]: Emulating election...
I20260812 17:59:45.285602 17557 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:45.290009 17557 raft_consensus.cc:686] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 3 LEADER]: Becoming Leader. State: Replica: 289fa0bce41d46d9a36c74a96c4ee46f, State: Running, Role: LEADER
I20260812 17:59:45.290524 17557 consensus_queue.cc:237] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:45.291996 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:45.295140 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260812 17:59:45.295419 17597 catalog_manager.cc:5495] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f reported cstate change: term changed from 2 to 3, leader changed from 32118523b79b460fb9da5065225b3af1 (127.17.37.66) to 289fa0bce41d46d9a36c74a96c4ee46f (127.17.37.65). New cstate: current_term: 3 leader_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:45.398494 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260812 17:59:45.601776 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 2.2
I20260812 17:59:45.679481 17728 raft_consensus.cc:1226] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 3 LEADER]: Rejecting Update request from peer 32118523b79b460fb9da5065225b3af1 for earlier term 2. Current term is 3. Ops: []
I20260812 17:59:45.680668 17899 consensus_queue.cc:1046] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 17:59:45.681258 17899 consensus_queue.cc:1225] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Peer 289fa0bce41d46d9a36c74a96c4ee46f log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260812 17:59:45.681726 17878 raft_consensus.cc:3032] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 17:59:45.681985 17878 raft_consensus.cc:729] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:45.682453 17878 consensus_queue.cc:260] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:45.683116 17878 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:45.795220 17814 raft_consensus.cc:1261] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 3 FOLLOWER]: Refusing update from remote peer 289fa0bce41d46d9a36c74a96c4ee46f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 17:59:45.796298 17897 consensus_queue.cc:1035] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Connected to new peer: Peer: permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 17:59:46.105180 17557 ts_tablet_manager-itest.cc:367] Electing peer 1...
I20260812 17:59:46.105409 17557 raft_consensus.cc:412] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 1 FOLLOWER]: Emulating election...
I20260812 17:59:46.105702 17557 raft_consensus.cc:3037] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:46.109891 17557 raft_consensus.cc:686] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 LEADER]: Becoming Leader. State: Replica: 289fa0bce41d46d9a36c74a96c4ee46f, State: Running, Role: LEADER
I20260812 17:59:46.110525 17557 consensus_queue.cc:237] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:46.112411 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:46.115808 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260812 17:59:46.115376 17597 catalog_manager.cc:5495] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f reported cstate change: term changed from 1 to 2, leader changed from 32118523b79b460fb9da5065225b3af1 (127.17.37.66) to 289fa0bce41d46d9a36c74a96c4ee46f (127.17.37.65). New cstate: current_term: 2 leader_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:46.219038 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260812 17:59:46.331539 17728 raft_consensus.cc:1226] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 LEADER]: Rejecting Update request from peer 32118523b79b460fb9da5065225b3af1 for earlier term 1. Current term is 2. Ops: []
I20260812 17:59:46.332662 17916 consensus_queue.cc:1046] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:46.333560 17916 consensus_queue.cc:1225] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [LEADER]: Peer 289fa0bce41d46d9a36c74a96c4ee46f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260812 17:59:46.333981 17917 raft_consensus.cc:3032] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 17:59:46.334270 17917 raft_consensus.cc:729] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:46.334722 17917 consensus_queue.cc:260] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:46.335350 17917 raft_consensus.cc:3037] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:46.422693 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 2.2 1.1
I20260812 17:59:46.600486 17814 raft_consensus.cc:1261] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 2 FOLLOWER]: Refusing update from remote peer 289fa0bce41d46d9a36c74a96c4ee46f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 17:59:46.601965 17897 consensus_queue.cc:1035] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Connected to new peer: Peer: permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:46.726557 17557 ts_tablet_manager-itest.cc:367] Electing peer 3...
I20260812 17:59:46.726850 17557 raft_consensus.cc:412] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 3 FOLLOWER]: Emulating election...
I20260812 17:59:46.727129 17557 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 17:59:46.731391 17557 raft_consensus.cc:686] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 4 LEADER]: Becoming Leader. State: Replica: 32118523b79b460fb9da5065225b3af1, State: Running, Role: LEADER
I20260812 17:59:46.732043 17557 consensus_queue.cc:237] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:46.733418 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:46.736550 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260812 17:59:46.736500 17600 catalog_manager.cc:5495] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 reported cstate change: term changed from 3 to 4, leader changed from 289fa0bce41d46d9a36c74a96c4ee46f (127.17.37.65) to 32118523b79b460fb9da5065225b3af1 (127.17.37.66). New cstate: current_term: 4 leader_uuid: "32118523b79b460fb9da5065225b3af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } health_report { overall_health: HEALTHY } } }
I20260812 17:59:46.839823 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260812 17:59:46.856528 17814 raft_consensus.cc:1226] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 4 LEADER]: Rejecting Update request from peer 289fa0bce41d46d9a36c74a96c4ee46f for earlier term 3. Current term is 4. Ops: []
I20260812 17:59:46.857689 17897 consensus_queue.cc:1046] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 17:59:46.858300 17897 consensus_queue.cc:1225] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [LEADER]: Peer 32118523b79b460fb9da5065225b3af1 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260812 17:59:46.858628 17920 raft_consensus.cc:3032] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 3 LEADER]: Stepping down as leader of term 3
I20260812 17:59:46.858860 17920 raft_consensus.cc:729] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 289fa0bce41d46d9a36c74a96c4ee46f, State: Running, Role: LEADER
I20260812 17:59:46.859253 17920 consensus_queue.cc:260] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 } } peers { permanent_uuid: "32118523b79b460fb9da5065225b3af1" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 41999 } }
I20260812 17:59:46.859848 17920 raft_consensus.cc:3037] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 3 FOLLOWER]: Advancing to term 4
I20260812 17:59:47.043051 17557 cluster_itest_util.cc:256] Not converged past 0 yet: 3.3 4.4
I20260812 17:59:47.248070 17728 raft_consensus.cc:1261] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 4 FOLLOWER]: Refusing update from remote peer 32118523b79b460fb9da5065225b3af1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 17:59:47.249145 17927 consensus_queue.cc:1035] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "289fa0bce41d46d9a36c74a96c4ee46f" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 43029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 17:59:47.548247 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 17:59:47.564913 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:47.565428 17557 tablet_replica.cc:330] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f: stopping tablet replica
I20260812 17:59:47.566103 17557 raft_consensus.cc:2229] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260812 17:59:47.566533 17557 raft_consensus.cc:2258] T 868ad21f937c464aa042ed8480ff32c9 P 289fa0bce41d46d9a36c74a96c4ee46f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:47.569921 17557 tablet_replica.cc:330] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f: stopping tablet replica
I20260812 17:59:47.570297 17557 raft_consensus.cc:2229] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 LEADER]: Raft consensus shutting down.
I20260812 17:59:47.570761 17557 raft_consensus.cc:2258] T 4e17305d78dd41bb8a58496f33a75c9f P 289fa0bce41d46d9a36c74a96c4ee46f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:47.658041 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
W20260812 17:59:47.661999 17772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.37.65:43029: connect: Connection refused (error 111)
W20260812 17:59:47.664806 17772 consensus_peers.cc:487] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 -> Peer 289fa0bce41d46d9a36c74a96c4ee46f (127.17.37.65:43029): Couldn't send request to peer 289fa0bce41d46d9a36c74a96c4ee46f. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:43029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 17:59:47.668183 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 17:59:47.683787 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:47.684208 17557 tablet_replica.cc:330] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1: stopping tablet replica
I20260812 17:59:47.684612 17557 raft_consensus.cc:2229] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 17:59:47.684958 17557 raft_consensus.cc:2258] T 4e17305d78dd41bb8a58496f33a75c9f P 32118523b79b460fb9da5065225b3af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:47.686326 17557 tablet_replica.cc:330] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1: stopping tablet replica
I20260812 17:59:47.686735 17557 raft_consensus.cc:2229] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 4 LEADER]: Raft consensus shutting down.
I20260812 17:59:47.687225 17557 raft_consensus.cc:2258] T 868ad21f937c464aa042ed8480ff32c9 P 32118523b79b460fb9da5065225b3af1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:47.705232 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 17:59:47.712904 17557 master.cc:537] Master@127.17.37.126:44901 shutting down...
I20260812 17:59:48.013036 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:48.013532 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:48.013898 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 71b7c3d298424063918ab6df990e407d: stopping tablet replica
I20260812 17:59:48.030879 17557 master.cc:552] Master@127.17.37.126:44901 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (7516 ms)
[ RUN ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260812 17:59:48.056885 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:44559
I20260812 17:59:48.057927 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.062784 17940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.063377 17941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.065575 17943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.066008 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:48.066596 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.066785 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.066937 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588066922 us; error 0 us; skew 500 ppm
I20260812 17:59:48.067405 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.074281 17557 webserver.cc:460] Webserver started at http://127.17.37.126:43775/ using document root <none> and password file <none>
I20260812 17:59:48.074682 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.074854 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.075081 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.076038 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "6c30649b52554c80bb87e3ae960d566c"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.079916 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 17:59:48.082510 17948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.083127 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:59:48.083356 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "6c30649b52554c80bb87e3ae960d566c"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.083592 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.092607 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.093425 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.125416 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:44559
I20260812 17:59:48.125512 18005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:44559 every 8 connection(s)
I20260812 17:59:48.128914 18006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:48.137099 18006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c: Bootstrap starting.
I20260812 17:59:48.140636 18006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:48.143750 18006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c: No bootstrap required, opened a new log
I20260812 17:59:48.145263 18006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER }
I20260812 17:59:48.145589 18006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:48.145766 18006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c30649b52554c80bb87e3ae960d566c, State: Initialized, Role: FOLLOWER
I20260812 17:59:48.146378 18006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER }
I20260812 17:59:48.146785 18006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:59:48.146962 18006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:59:48.147156 18006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:48.150411 18006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER }
I20260812 17:59:48.150847 18006 leader_election.cc:302] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c30649b52554c80bb87e3ae960d566c; no voters:
I20260812 17:59:48.151826 18006 leader_election.cc:288] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:59:48.152130 18010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:48.153422 18010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 1 LEADER]: Becoming Leader. State: Replica: 6c30649b52554c80bb87e3ae960d566c, State: Running, Role: LEADER
I20260812 17:59:48.154119 18010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER }
I20260812 17:59:48.154663 18006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:48.156747 18012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c30649b52554c80bb87e3ae960d566c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER } }
I20260812 17:59:48.156975 18013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c30649b52554c80bb87e3ae960d566c. Latest consensus state: current_term: 1 leader_uuid: "6c30649b52554c80bb87e3ae960d566c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c30649b52554c80bb87e3ae960d566c" member_type: VOTER } }
I20260812 17:59:48.157480 18012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:48.157616 18013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:48.162210 18018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:48.167083 18018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:48.169793 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:48.174728 18018 catalog_manager.cc:1347] Generated new cluster ID: be20a59f9cf7443592013ce7da372d26
I20260812 17:59:48.174989 18018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:48.202847 18018 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:48.204092 18018 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:48.212270 18018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c: Generated new TSK 0
I20260812 17:59:48.212764 18018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:48.235466 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.240465 18032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.241689 18033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.243057 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:48.243575 18035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.244413 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.244573 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.244763 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588244736 us; error 0 us; skew 500 ppm
I20260812 17:59:48.245234 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.247488 17557 webserver.cc:460] Webserver started at http://127.17.37.65:35185/ using document root <none> and password file <none>
I20260812 17:59:48.247908 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.248090 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.248342 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.249331 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "ad519369e875479aa1130f0926a23a61"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.253264 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:59:48.256224 18041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.256945 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:59:48.257229 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "ad519369e875479aa1130f0926a23a61"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.257489 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.269194 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.270164 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.271289 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:48.273322 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:48.273533 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.273754 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:48.273988 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 17:59:48.309688 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:39689
I20260812 17:59:48.309754 18114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:39689 every 8 connection(s)
I20260812 17:59:48.313822 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.321080 18119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.321616 18120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.324247 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:48.324667 18123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.325554 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.325788 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.326015 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588325997 us; error 0 us; skew 500 ppm
I20260812 17:59:48.326517 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.328488 18115 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44559
I20260812 17:59:48.328802 18115 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:48.329174 17557 webserver.cc:460] Webserver started at http://127.17.37.66:36985/ using document root <none> and password file <none>
I20260812 17:59:48.329545 18115 heartbeater.cc:511] Master 127.17.37.126:44559 requested a full tablet report, sending...
I20260812 17:59:48.329622 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.329912 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.330200 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.331396 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "d1eca908ff344775a5a9ad91fee4b028"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.331553 17967 ts_manager.cc:194] Registered new tserver with Master: ad519369e875479aa1130f0926a23a61 (127.17.37.65:39689)
I20260812 17:59:48.334017 17967 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48632
I20260812 17:59:48.336825 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 17:59:48.339706 18130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.340394 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:59:48.340775 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "d1eca908ff344775a5a9ad91fee4b028"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.341050 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.349159 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.350080 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.351256 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:48.353278 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:48.353472 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.353731 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:48.353953 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 17:59:48.389243 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:37813
I20260812 17:59:48.389339 18204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:37813 every 8 connection(s)
I20260812 17:59:48.403569 18205 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44559
I20260812 17:59:48.403914 18205 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:48.404450 18205 heartbeater.cc:511] Master 127.17.37.126:44559 requested a full tablet report, sending...
I20260812 17:59:48.406000 17967 ts_manager.cc:194] Registered new tserver with Master: d1eca908ff344775a5a9ad91fee4b028 (127.17.37.66:37813)
I20260812 17:59:48.406368 17557 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.014222776s
I20260812 17:59:48.407480 17967 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48636
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:421: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260812 17:59:48.427017 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 17:59:48.436944 18115 heartbeater.cc:503] Master 127.17.37.126:44559 was elected leader, sending a full tablet report...
I20260812 17:59:48.444550 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:48.459295 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 17:59:48.465088 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 17:59:48.478397 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:48.492884 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 17:59:48.498849 17557 master.cc:537] Master@127.17.37.126:44559 shutting down...
I20260812 17:59:48.510814 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:48.511171 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:48.511456 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6c30649b52554c80bb87e3ae960d566c: stopping tablet replica
I20260812 17:59:48.529286 17557 master.cc:552] Master@127.17.37.126:44559 shutdown complete.
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (491 ms)
[ RUN ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260812 17:59:48.548470 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:34495
I20260812 17:59:48.549360 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.553491 18221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.554737 18222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.556126 18224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.556392 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:48.557058 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.557225 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.557325 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588557318 us; error 0 us; skew 500 ppm
I20260812 17:59:48.557709 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.559851 17557 webserver.cc:460] Webserver started at http://127.17.37.126:32869/ using document root <none> and password file <none>
I20260812 17:59:48.560266 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.560400 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.560604 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.561534 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "eb8194cafab64abc855c1b43ea64aa9a"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.565492 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 17:59:48.568558 18233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.569198 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:59:48.569396 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "eb8194cafab64abc855c1b43ea64aa9a"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.569602 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.599088 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.599987 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.634537 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:34495
I20260812 17:59:48.634624 18294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:34495 every 8 connection(s)
I20260812 17:59:48.637778 18295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:48.646072 18295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a: Bootstrap starting.
I20260812 17:59:48.649677 18295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:48.652938 18295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a: No bootstrap required, opened a new log
I20260812 17:59:48.654424 18295 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER }
I20260812 17:59:48.654752 18295 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:48.654901 18295 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8194cafab64abc855c1b43ea64aa9a, State: Initialized, Role: FOLLOWER
I20260812 17:59:48.655364 18295 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER }
I20260812 17:59:48.655730 18295 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:59:48.655890 18295 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:59:48.656116 18295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:48.659464 18295 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER }
I20260812 17:59:48.659854 18295 leader_election.cc:302] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb8194cafab64abc855c1b43ea64aa9a; no voters:
I20260812 17:59:48.660730 18295 leader_election.cc:288] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:59:48.660992 18299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:48.662225 18299 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 1 LEADER]: Becoming Leader. State: Replica: eb8194cafab64abc855c1b43ea64aa9a, State: Running, Role: LEADER
I20260812 17:59:48.662765 18299 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER }
I20260812 17:59:48.663316 18295 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:48.665355 18301 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb8194cafab64abc855c1b43ea64aa9a. Latest consensus state: current_term: 1 leader_uuid: "eb8194cafab64abc855c1b43ea64aa9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER } }
I20260812 17:59:48.665297 18300 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb8194cafab64abc855c1b43ea64aa9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8194cafab64abc855c1b43ea64aa9a" member_type: VOTER } }
I20260812 17:59:48.666008 18301 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:48.666069 18300 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:48.674343 18304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:48.681716 18304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:48.682564 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:48.689940 18304 catalog_manager.cc:1347] Generated new cluster ID: 41f8acfa332d4409aa4638a454bee620
I20260812 17:59:48.690173 18304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:48.712157 18304 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:48.713598 18304 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:48.726001 18304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a: Generated new TSK 0
I20260812 17:59:48.726713 18304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:48.748217 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.753160 18320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.754231 18321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.755481 18325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.756162 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:48.756824 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.757014 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.757195 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588757166 us; error 0 us; skew 500 ppm
I20260812 17:59:48.757659 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.759765 17557 webserver.cc:460] Webserver started at http://127.17.37.65:45813/ using document root <none> and password file <none>
I20260812 17:59:48.760234 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.760418 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.760680 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.761660 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "0fe0e8f085174f3187092b3a1f1dd934"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.766208 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:59:48.768927 18332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.769670 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 17:59:48.769927 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "0fe0e8f085174f3187092b3a1f1dd934"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.770133 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.800495 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.801362 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.802490 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:48.804332 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:48.804479 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.804729 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:48.804842 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.839295 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:45963
I20260812 17:59:48.839388 18406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:45963 every 8 connection(s)
I20260812 17:59:48.843289 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:48.849896 18412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:48.851351 18413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.853853 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:48.855048 18415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:48.855986 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:48.856197 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:48.856370 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557588856355 us; error 0 us; skew 500 ppm
I20260812 17:59:48.856807 18407 heartbeater.cc:347] Connected to a master server at 127.17.37.126:34495
I20260812 17:59:48.856963 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:48.857188 18407 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:48.858042 18407 heartbeater.cc:511] Master 127.17.37.126:34495 requested a full tablet report, sending...
I20260812 17:59:48.859490 17557 webserver.cc:460] Webserver started at http://127.17.37.66:37775/ using document root <none> and password file <none>
I20260812 17:59:48.860059 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:48.860023 18251 ts_manager.cc:194] Registered new tserver with Master: 0fe0e8f085174f3187092b3a1f1dd934 (127.17.37.65:45963)
I20260812 17:59:48.860348 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:48.860682 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:48.862023 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "3f9664ced29945b0a1f73838be7c75d5"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.862466 18251 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36780
I20260812 17:59:48.866986 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:59:48.869772 18421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.870648 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 17:59:48.870988 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "3f9664ced29945b0a1f73838be7c75d5"
format_stamp: "Formatted at 2026-08-12 17:59:48 on dist-test-slave-6nmv"
I20260812 17:59:48.871268 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:48.892057 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:48.892949 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:48.894138 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:48.896189 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:48.896353 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.896631 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:48.896761 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:48.929692 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:38375
I20260812 17:59:48.929768 18497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:38375 every 8 connection(s)
I20260812 17:59:48.942862 18498 heartbeater.cc:347] Connected to a master server at 127.17.37.126:34495
I20260812 17:59:48.943198 18498 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:48.943770 18498 heartbeater.cc:511] Master 127.17.37.126:34495 requested a full tablet report, sending...
I20260812 17:59:48.945423 18251 ts_manager.cc:194] Registered new tserver with Master: 3f9664ced29945b0a1f73838be7c75d5 (127.17.37.66:38375)
I20260812 17:59:48.945500 17557 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.013085531s
I20260812 17:59:48.947140 18251 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36794
I20260812 17:59:48.965477 18407 heartbeater.cc:503] Master 127.17.37.126:34495 was elected leader, sending a full tablet report...
I20260812 17:59:48.965397 18251 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:59:48.967096 18251 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260812 17:59:48.997834 18454 tablet_service.cc:1467] Processing CreateTablet for tablet ff01313834974e9e8b2a3a1bb1bc3a08 (DEFAULT_TABLE table=test-table [id=fb41d1e619d64b12940348e02467a34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:48.998052 18365 tablet_service.cc:1467] Processing CreateTablet for tablet ff01313834974e9e8b2a3a1bb1bc3a08 (DEFAULT_TABLE table=test-table [id=fb41d1e619d64b12940348e02467a34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:48.998876 18454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff01313834974e9e8b2a3a1bb1bc3a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:48.999069 18365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff01313834974e9e8b2a3a1bb1bc3a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:49.010106 18515 tablet_bootstrap.cc:492] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: Bootstrap starting.
I20260812 17:59:49.010054 18514 tablet_bootstrap.cc:492] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: Bootstrap starting.
I20260812 17:59:49.014158 18515 tablet_bootstrap.cc:654] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:49.014398 18514 tablet_bootstrap.cc:654] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:49.018098 18515 tablet_bootstrap.cc:492] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: No bootstrap required, opened a new log
I20260812 17:59:49.018172 18514 tablet_bootstrap.cc:492] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: No bootstrap required, opened a new log
I20260812 17:59:49.018424 18515 ts_tablet_manager.cc:1397] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260812 17:59:49.018515 18514 ts_tablet_manager.cc:1397] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260812 17:59:49.020044 18515 raft_consensus.cc:348] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.020215 18514 raft_consensus.cc:348] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.020522 18515 raft_consensus.cc:729] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9664ced29945b0a1f73838be7c75d5, State: Initialized, Role: FOLLOWER
I20260812 17:59:49.020759 18514 raft_consensus.cc:729] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Initialized, Role: FOLLOWER
I20260812 17:59:49.021023 18515 consensus_queue.cc:260] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.021330 18514 consensus_queue.cc:260] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.023452 18515 ts_tablet_manager.cc:1428] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 17:59:49.023748 18498 heartbeater.cc:503] Master 127.17.37.126:34495 was elected leader, sending a full tablet report...
I20260812 17:59:49.025195 18514 ts_tablet_manager.cc:1428] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:59:49.057890 17557 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260812 17:59:49.058063 17557 raft_consensus.cc:412] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 0 FOLLOWER]: Emulating election...
I20260812 17:59:49.058261 17557 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:49.061933 17557 raft_consensus.cc:686] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Running, Role: LEADER
W20260812 17:59:49.062327 18407 heartbeater.cc:644] Failed to heartbeat to 127.17.37.126:34495 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260812 17:59:49.062431 17557 consensus_queue.cc:237] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.064996 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:49.085768 17557 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260812 17:59:49.189347 17557 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260812 17:59:49.393203 17557 cluster_itest_util.cc:256] Not converged past 1 yet: 1.1 0.0
I20260812 17:59:49.673113 18464 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:49.678705 18523 consensus_queue.cc:1035] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:49.698005 17557 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260812 17:59:49.698259 17557 raft_consensus.cc:412] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 1 LEADER]: Emulating election...
I20260812 17:59:49.698482 17557 raft_consensus.cc:3032] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 17:59:49.698696 17557 raft_consensus.cc:729] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Running, Role: LEADER
I20260812 17:59:49.699155 17557 consensus_queue.cc:260] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.699779 17557 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:49.703667 17557 raft_consensus.cc:686] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Running, Role: LEADER
I20260812 17:59:49.704227 17557 consensus_queue.cc:237] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:49.705478 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:49.708657 17557 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260812 17:59:49.812561 17557 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260812 17:59:50.016592 17557 cluster_itest_util.cc:256] Not converged past 2 yet: 2.2 1.1
I20260812 17:59:50.199631 18464 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:50.203491 18464 raft_consensus.cc:1261] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 2 FOLLOWER]: Refusing update from remote peer 0fe0e8f085174f3187092b3a1f1dd934: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 17:59:50.204365 18523 consensus_queue.cc:1035] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:50.321084 17557 ts_tablet_manager-itest.cc:367] Electing peer 0...
I20260812 17:59:50.321270 17557 raft_consensus.cc:412] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 2 LEADER]: Emulating election...
I20260812 17:59:50.321491 17557 raft_consensus.cc:3032] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 17:59:50.321689 17557 raft_consensus.cc:729] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Running, Role: LEADER
I20260812 17:59:50.322134 17557 consensus_queue.cc:260] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:50.322769 17557 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:50.326421 17557 raft_consensus.cc:686] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 3 LEADER]: Becoming Leader. State: Replica: 0fe0e8f085174f3187092b3a1f1dd934, State: Running, Role: LEADER
I20260812 17:59:50.326958 17557 consensus_queue.cc:237] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 } } peers { permanent_uuid: "0fe0e8f085174f3187092b3a1f1dd934" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 45963 } }
I20260812 17:59:50.328078 17557 ts_tablet_manager-itest.cc:370] Waiting for servers to agree...
I20260812 17:59:50.331005 17557 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260812 17:59:50.434324 17557 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260812 17:59:50.639829 17557 cluster_itest_util.cc:256] Not converged past 3 yet: 3.3 2.2
I20260812 17:59:50.917714 18464 raft_consensus.cc:3037] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:50.922736 18464 raft_consensus.cc:1261] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 3 FOLLOWER]: Refusing update from remote peer 0fe0e8f085174f3187092b3a1f1dd934: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260812 17:59:50.924206 18539 consensus_queue.cc:1035] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9664ced29945b0a1f73838be7c75d5" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 17:59:50.946398 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 17:59:50.965315 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:50.965946 17557 tablet_replica.cc:330] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934: stopping tablet replica
I20260812 17:59:50.966487 17557 raft_consensus.cc:2229] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 3 LEADER]: Raft consensus shutting down.
I20260812 17:59:50.967031 17557 raft_consensus.cc:2258] T ff01313834974e9e8b2a3a1bb1bc3a08 P 0fe0e8f085174f3187092b3a1f1dd934 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:50.975595 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 17:59:50.984191 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 17:59:51.000061 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:51.000674 17557 tablet_replica.cc:330] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5: stopping tablet replica
I20260812 17:59:51.001212 17557 raft_consensus.cc:2229] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 17:59:51.001605 17557 raft_consensus.cc:2258] T ff01313834974e9e8b2a3a1bb1bc3a08 P 3f9664ced29945b0a1f73838be7c75d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:51.019543 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 17:59:51.027231 17557 master.cc:537] Master@127.17.37.126:34495 shutting down...
I20260812 17:59:51.042711 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:51.043386 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:51.043727 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P eb8194cafab64abc855c1b43ea64aa9a: stopping tablet replica
I20260812 17:59:51.060111 17557 master.cc:552] Master@127.17.37.126:34495 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2539 ms)
[----------] 3 tests from LeadershipChangeReportingTest (10548 ms total)
[----------] 4 tests from TsTabletManagerITest
[ RUN ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260812 17:59:51.088120 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:46343
I20260812 17:59:51.089038 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:51.093856 18553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.094615 18554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.095929 18556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:51.096870 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:51.097513 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:51.097697 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:51.097909 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557591097894 us; error 0 us; skew 500 ppm
I20260812 17:59:51.098388 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:51.100644 17557 webserver.cc:460] Webserver started at http://127.17.37.126:38537/ using document root <none> and password file <none>
I20260812 17:59:51.101089 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:51.101246 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:51.101521 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:51.102620 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "beb79ec8bcd945838d04e0db94835e39"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.106413 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:59:51.109295 18562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.109990 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 17:59:51.110230 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "beb79ec8bcd945838d04e0db94835e39"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.110469 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:51.125298 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:51.126371 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:51.162292 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:46343
I20260812 17:59:51.162372 18622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:46343 every 8 connection(s)
I20260812 17:59:51.166334 18623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:51.175463 18623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39: Bootstrap starting.
I20260812 17:59:51.179487 18623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:51.183096 18623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39: No bootstrap required, opened a new log
I20260812 17:59:51.184759 18623 raft_consensus.cc:348] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER }
I20260812 17:59:51.185155 18623 raft_consensus.cc:374] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:51.185316 18623 raft_consensus.cc:729] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beb79ec8bcd945838d04e0db94835e39, State: Initialized, Role: FOLLOWER
I20260812 17:59:51.185845 18623 consensus_queue.cc:260] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER }
I20260812 17:59:51.186337 18623 raft_consensus.cc:388] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:59:51.186524 18623 raft_consensus.cc:482] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:59:51.186721 18623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:51.190047 18623 raft_consensus.cc:504] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER }
I20260812 17:59:51.190447 18623 leader_election.cc:302] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: beb79ec8bcd945838d04e0db94835e39; no voters:
I20260812 17:59:51.191354 18623 leader_election.cc:288] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:59:51.191753 18626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:51.192994 18626 raft_consensus.cc:686] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 1 LEADER]: Becoming Leader. State: Replica: beb79ec8bcd945838d04e0db94835e39, State: Running, Role: LEADER
I20260812 17:59:51.193599 18626 consensus_queue.cc:237] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER }
I20260812 17:59:51.194276 18623 sys_catalog.cc:564] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:51.196331 18629 sys_catalog.cc:455] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader beb79ec8bcd945838d04e0db94835e39. Latest consensus state: current_term: 1 leader_uuid: "beb79ec8bcd945838d04e0db94835e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER } }
I20260812 17:59:51.196398 18628 sys_catalog.cc:455] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "beb79ec8bcd945838d04e0db94835e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beb79ec8bcd945838d04e0db94835e39" member_type: VOTER } }
I20260812 17:59:51.196934 18629 sys_catalog.cc:458] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:51.197026 18628 sys_catalog.cc:458] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:51.199782 18632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:51.207759 18632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:51.217656 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:51.219208 18632 catalog_manager.cc:1347] Generated new cluster ID: 26500b8f9abb4d9f86451a91fb644c69
I20260812 17:59:51.219422 18632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:51.242856 18632 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:51.244175 18632 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:51.251876 18632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39: Generated new TSK 0
I20260812 17:59:51.252395 18632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:51.283957 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:51.289696 18649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.291081 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:51.292516 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:51.293207 18654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:51.294004 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:51.294203 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:51.294373 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557591294343 us; error 0 us; skew 500 ppm
I20260812 17:59:51.294854 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:51.296979 17557 webserver.cc:460] Webserver started at http://127.17.37.65:39219/ using document root <none> and password file <none>
I20260812 17:59:51.297447 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:51.297636 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:51.297917 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:51.299105 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "2de280aa2e5e43dc9ed293576b297085"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.303396 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:59:51.306393 18661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.307101 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260812 17:59:51.307412 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "2de280aa2e5e43dc9ed293576b297085"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.307657 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:51.327270 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:51.328293 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:51.329661 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:51.331835 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:51.332041 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.332301 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:51.332489 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.368861 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:40579
I20260812 17:59:51.368974 18734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:40579 every 8 connection(s)
I20260812 17:59:51.373274 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:51.380129 18742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.381094 18739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.383868 18744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:51.384790 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:51.385560 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:51.385870 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:51.386054 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557591386038 us; error 0 us; skew 500 ppm
I20260812 17:59:51.386706 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:51.387853 18735 heartbeater.cc:347] Connected to a master server at 127.17.37.126:46343
I20260812 17:59:51.388214 18735 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:51.388885 18735 heartbeater.cc:511] Master 127.17.37.126:46343 requested a full tablet report, sending...
I20260812 17:59:51.389281 17557 webserver.cc:460] Webserver started at http://127.17.37.66:36831/ using document root <none> and password file <none>
I20260812 17:59:51.389847 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:51.390070 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:51.390345 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:51.390856 18585 ts_manager.cc:194] Registered new tserver with Master: 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579)
I20260812 17:59:51.391521 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "efa6fd1fd6b04b3b9799b2093407ada8"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.392522 18585 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52444
I20260812 17:59:51.396420 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:59:51.399565 18750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.400379 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 17:59:51.400638 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "efa6fd1fd6b04b3b9799b2093407ada8"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.400871 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:51.409145 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:51.410277 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:51.411547 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:51.413674 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:51.413910 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.414120 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:51.414268 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.450814 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:43175
I20260812 17:59:51.450898 18829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:43175 every 8 connection(s)
I20260812 17:59:51.454895 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:51.461248 18835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.461977 18836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:51.464634 18839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:51.464805 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:51.465654 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:51.465876 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:51.466064 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557591466048 us; error 0 us; skew 500 ppm
I20260812 17:59:51.466642 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:51.467360 18830 heartbeater.cc:347] Connected to a master server at 127.17.37.126:46343
I20260812 17:59:51.467629 18830 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:51.468096 18830 heartbeater.cc:511] Master 127.17.37.126:46343 requested a full tablet report, sending...
I20260812 17:59:51.469962 18585 ts_manager.cc:194] Registered new tserver with Master: efa6fd1fd6b04b3b9799b2093407ada8 (127.17.37.66:43175)
I20260812 17:59:51.470592 17557 webserver.cc:460] Webserver started at http://127.17.37.67:41937/ using document root <none> and password file <none>
I20260812 17:59:51.471203 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:51.471414 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:51.471695 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:51.471958 18585 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52452
I20260812 17:59:51.473171 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-2-root/instance:
uuid: "3378cfbec710463b803ce07c6e06ecac"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.477169 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 17:59:51.480298 18844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.480998 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:59:51.481266 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-2-root
uuid: "3378cfbec710463b803ce07c6e06ecac"
format_stamp: "Formatted at 2026-08-12 17:59:51 on dist-test-slave-6nmv"
I20260812 17:59:51.481549 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786557580379316-17557-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:51.506512 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:51.507606 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:51.508775 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:51.510617 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:51.510800 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.511027 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:51.511178 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:51.573787 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.67:41193
I20260812 17:59:51.573885 18912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.67:41193 every 8 connection(s)
I20260812 17:59:51.590452 18913 heartbeater.cc:347] Connected to a master server at 127.17.37.126:46343
I20260812 17:59:51.590765 18913 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:51.591379 18913 heartbeater.cc:511] Master 127.17.37.126:46343 requested a full tablet report, sending...
I20260812 17:59:51.593125 18585 ts_manager.cc:194] Registered new tserver with Master: 3378cfbec710463b803ce07c6e06ecac (127.17.37.67:41193)
I20260812 17:59:51.593981 17557 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015656706s
I20260812 17:59:51.594949 18585 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52454
I20260812 17:59:51.618611 18585 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260812 17:59:51.619933 18585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:59:51.664981 18784 tablet_service.cc:1467] Processing CreateTablet for tablet 6611f2f6d1d94bf0951c75e37d04183d (DEFAULT_TABLE table=test-table [id=e5954741fb3049e483f1b8b9859c66cf]), partition=
I20260812 17:59:51.666033 18784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6611f2f6d1d94bf0951c75e37d04183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:51.667402 18697 tablet_service.cc:1467] Processing CreateTablet for tablet 6611f2f6d1d94bf0951c75e37d04183d (DEFAULT_TABLE table=test-table [id=e5954741fb3049e483f1b8b9859c66cf]), partition=
I20260812 17:59:51.668437 18697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6611f2f6d1d94bf0951c75e37d04183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:51.670526 18873 tablet_service.cc:1467] Processing CreateTablet for tablet 6611f2f6d1d94bf0951c75e37d04183d (DEFAULT_TABLE table=test-table [id=e5954741fb3049e483f1b8b9859c66cf]), partition=
I20260812 17:59:51.671528 18873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6611f2f6d1d94bf0951c75e37d04183d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:51.682623 18938 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: Bootstrap starting.
I20260812 17:59:51.682989 18936 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: Bootstrap starting.
I20260812 17:59:51.686540 18939 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: Bootstrap starting.
I20260812 17:59:51.690150 18938 tablet_bootstrap.cc:654] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:51.690559 18936 tablet_bootstrap.cc:654] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:51.691365 18939 tablet_bootstrap.cc:654] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:51.698171 18936 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: No bootstrap required, opened a new log
I20260812 17:59:51.698654 18936 ts_tablet_manager.cc:1397] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.001s
I20260812 17:59:51.698917 18938 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: No bootstrap required, opened a new log
I20260812 17:59:51.698964 18939 tablet_bootstrap.cc:492] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: No bootstrap required, opened a new log
I20260812 17:59:51.699476 18938 ts_tablet_manager.cc:1397] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.006s
I20260812 17:59:51.699484 18939 ts_tablet_manager.cc:1397] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260812 17:59:51.700944 18936 raft_consensus.cc:348] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.701588 18936 raft_consensus.cc:374] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:51.701889 18936 raft_consensus.cc:729] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efa6fd1fd6b04b3b9799b2093407ada8, State: Initialized, Role: FOLLOWER
I20260812 17:59:51.701951 18938 raft_consensus.cc:348] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.702762 18938 raft_consensus.cc:374] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:51.702387 18939 raft_consensus.cc:348] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.702639 18936 consensus_queue.cc:260] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.703123 18938 raft_consensus.cc:729] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de280aa2e5e43dc9ed293576b297085, State: Initialized, Role: FOLLOWER
I20260812 17:59:51.703179 18939 raft_consensus.cc:374] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:51.703562 18939 raft_consensus.cc:729] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3378cfbec710463b803ce07c6e06ecac, State: Initialized, Role: FOLLOWER
I20260812 17:59:51.704191 18939 consensus_queue.cc:260] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.703836 18938 consensus_queue.cc:260] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.704897 18830 heartbeater.cc:503] Master 127.17.37.126:46343 was elected leader, sending a full tablet report...
I20260812 17:59:51.707944 18936 ts_tablet_manager.cc:1428] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: Time spent starting tablet: real 0.009s user 0.000s sys 0.006s
I20260812 17:59:51.710242 18938 ts_tablet_manager.cc:1428] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260812 17:59:51.711026 18939 ts_tablet_manager.cc:1428] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: Time spent starting tablet: real 0.011s user 0.004s sys 0.006s
I20260812 17:59:51.711205 18735 heartbeater.cc:503] Master 127.17.37.126:46343 was elected leader, sending a full tablet report...
I20260812 17:59:51.711197 18913 heartbeater.cc:503] Master 127.17.37.126:46343 was elected leader, sending a full tablet report...
I20260812 17:59:51.866146 18946 raft_consensus.cc:482] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:51.866644 18946 raft_consensus.cc:504] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.868592 18946 leader_election.cc:288] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efa6fd1fd6b04b3b9799b2093407ada8 (127.17.37.66:43175), 3378cfbec710463b803ce07c6e06ecac (127.17.37.67:41193)
I20260812 17:59:51.881443 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "2de280aa2e5e43dc9ed293576b297085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" is_pre_election: true
I20260812 17:59:51.882484 18799 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de280aa2e5e43dc9ed293576b297085 in term 0.
I20260812 17:59:51.883165 18883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "2de280aa2e5e43dc9ed293576b297085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3378cfbec710463b803ce07c6e06ecac" is_pre_election: true
I20260812 17:59:51.883837 18883 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de280aa2e5e43dc9ed293576b297085 in term 0.
I20260812 17:59:51.883852 18665 leader_election.cc:302] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de280aa2e5e43dc9ed293576b297085, efa6fd1fd6b04b3b9799b2093407ada8; no voters:
I20260812 17:59:51.884712 18946 raft_consensus.cc:2781] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:51.885037 18946 raft_consensus.cc:482] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:51.885318 18946 raft_consensus.cc:3037] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:51.889753 18946 raft_consensus.cc:504] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.891302 18946 leader_election.cc:288] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [CANDIDATE]: Term 1 election: Requested vote from peers efa6fd1fd6b04b3b9799b2093407ada8 (127.17.37.66:43175), 3378cfbec710463b803ce07c6e06ecac (127.17.37.67:41193)
I20260812 17:59:51.891933 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "2de280aa2e5e43dc9ed293576b297085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa6fd1fd6b04b3b9799b2093407ada8"
I20260812 17:59:51.892215 18883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "2de280aa2e5e43dc9ed293576b297085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3378cfbec710463b803ce07c6e06ecac"
I20260812 17:59:51.892464 18799 raft_consensus.cc:3037] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:51.892729 18883 raft_consensus.cc:3037] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:51.899053 18799 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de280aa2e5e43dc9ed293576b297085 in term 1.
I20260812 17:59:51.899286 18883 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de280aa2e5e43dc9ed293576b297085 in term 1.
I20260812 17:59:51.899940 18665 leader_election.cc:302] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de280aa2e5e43dc9ed293576b297085, efa6fd1fd6b04b3b9799b2093407ada8; no voters:
I20260812 17:59:51.900482 18946 raft_consensus.cc:2781] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:51.901259 18946 raft_consensus.cc:686] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 1 LEADER]: Becoming Leader. State: Replica: 2de280aa2e5e43dc9ed293576b297085, State: Running, Role: LEADER
I20260812 17:59:51.901914 18946 consensus_queue.cc:237] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:51.908298 18584 catalog_manager.cc:5495] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65). New cstate: current_term: 1 leader_uuid: "2de280aa2e5e43dc9ed293576b297085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:52.496248 18954 consensus_queue.cc:1035] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:52.508226 18962 consensus_queue.cc:1035] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:54.005810 17557 tablet_replica.cc:330] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085: stopping tablet replica
I20260812 17:59:54.006389 17557 raft_consensus.cc:2229] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:54.007141 17557 raft_consensus.cc:2258] T 6611f2f6d1d94bf0951c75e37d04183d P 2de280aa2e5e43dc9ed293576b297085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:54.945921 18970 raft_consensus.cc:482] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2de280aa2e5e43dc9ed293576b297085)
I20260812 17:59:54.946432 18970 raft_consensus.cc:504] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:54.948292 18970 leader_election.cc:288] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579), 3378cfbec710463b803ce07c6e06ecac (127.17.37.67:41193)
I20260812 17:59:54.965010 18709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2de280aa2e5e43dc9ed293576b297085" is_pre_election: true
I20260812 17:59:54.965008 18883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3378cfbec710463b803ce07c6e06ecac" is_pre_election: true
W20260812 17:59:54.966539 18751 leader_election.cc:341] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579): Illegal state: cannot vote while shut down
I20260812 17:59:54.967113 18754 leader_election.cc:302] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efa6fd1fd6b04b3b9799b2093407ada8; no voters: 2de280aa2e5e43dc9ed293576b297085, 3378cfbec710463b803ce07c6e06ecac
I20260812 17:59:54.967793 18970 raft_consensus.cc:2726] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:55.456403 18976 raft_consensus.cc:482] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2de280aa2e5e43dc9ed293576b297085)
I20260812 17:59:55.456858 18976 raft_consensus.cc:504] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:55.458662 18976 leader_election.cc:288] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579), efa6fd1fd6b04b3b9799b2093407ada8 (127.17.37.66:43175)
I20260812 17:59:55.472687 18709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "3378cfbec710463b803ce07c6e06ecac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2de280aa2e5e43dc9ed293576b297085" is_pre_election: true
W20260812 17:59:55.473688 18845 leader_election.cc:341] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579): Illegal state: cannot vote while shut down
I20260812 17:59:55.474203 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "3378cfbec710463b803ce07c6e06ecac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" is_pre_election: true
I20260812 17:59:55.474682 18799 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3378cfbec710463b803ce07c6e06ecac in term 1.
I20260812 17:59:55.475539 18847 leader_election.cc:302] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3378cfbec710463b803ce07c6e06ecac, efa6fd1fd6b04b3b9799b2093407ada8; no voters: 2de280aa2e5e43dc9ed293576b297085
I20260812 17:59:55.476163 18976 raft_consensus.cc:2781] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:59:55.476447 18976 raft_consensus.cc:482] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2de280aa2e5e43dc9ed293576b297085)
I20260812 17:59:55.476747 18976 raft_consensus.cc:3037] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:55.480825 18976 raft_consensus.cc:504] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:55.482175 18976 leader_election.cc:288] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 election: Requested vote from peers 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579), efa6fd1fd6b04b3b9799b2093407ada8 (127.17.37.66:43175)
I20260812 17:59:55.482908 18709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "3378cfbec710463b803ce07c6e06ecac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2de280aa2e5e43dc9ed293576b297085"
I20260812 17:59:55.483043 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6611f2f6d1d94bf0951c75e37d04183d" candidate_uuid: "3378cfbec710463b803ce07c6e06ecac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efa6fd1fd6b04b3b9799b2093407ada8"
I20260812 17:59:55.483597 18799 raft_consensus.cc:3037] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 1 FOLLOWER]: Advancing to term 2
W20260812 17:59:55.483884 18845 leader_election.cc:341] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579): Illegal state: cannot vote while shut down
I20260812 17:59:55.487779 18799 raft_consensus.cc:2454] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3378cfbec710463b803ce07c6e06ecac in term 2.
I20260812 17:59:55.488551 18847 leader_election.cc:302] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3378cfbec710463b803ce07c6e06ecac, efa6fd1fd6b04b3b9799b2093407ada8; no voters: 2de280aa2e5e43dc9ed293576b297085
I20260812 17:59:55.489065 18976 raft_consensus.cc:2781] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 2 FOLLOWER]: Leader election won for term 2
I20260812 17:59:55.489784 18976 raft_consensus.cc:686] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 2 LEADER]: Becoming Leader. State: Replica: 3378cfbec710463b803ce07c6e06ecac, State: Running, Role: LEADER
I20260812 17:59:55.490408 18976 consensus_queue.cc:237] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de280aa2e5e43dc9ed293576b297085" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 40579 } } peers { permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 } } peers { permanent_uuid: "3378cfbec710463b803ce07c6e06ecac" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 41193 } }
I20260812 17:59:55.919303 18845 consensus_queue.cc:579] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [LEADER]: The tablet replica hosted on peer 2de280aa2e5e43dc9ed293576b297085 has failed
W20260812 17:59:55.919808 18845 consensus_peers.cc:487] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac -> Peer 2de280aa2e5e43dc9ed293576b297085 (127.17.37.65:40579): Couldn't send request to peer 2de280aa2e5e43dc9ed293576b297085. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260812 17:59:56.001205 18799 raft_consensus.cc:1261] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 2 FOLLOWER]: Refusing update from remote peer 3378cfbec710463b803ce07c6e06ecac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 17:59:56.002430 18976 consensus_queue.cc:1035] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [LEADER]: Connected to new peer: Peer: permanent_uuid: "efa6fd1fd6b04b3b9799b2093407ada8" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:56.041076 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 17:59:56.058358 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:56.075054 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 17:59:56.082195 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 17:59:56.097395 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:56.097976 17557 tablet_replica.cc:330] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8: stopping tablet replica
I20260812 17:59:56.098398 17557 raft_consensus.cc:2229] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 17:59:56.098791 17557 raft_consensus.cc:2258] T 6611f2f6d1d94bf0951c75e37d04183d P efa6fd1fd6b04b3b9799b2093407ada8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:56.116353 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 17:59:56.123127 17557 tablet_server.cc:178] TabletServer@127.17.37.67:0 shutting down...
I20260812 17:59:56.137738 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:56.138263 17557 tablet_replica.cc:330] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac: stopping tablet replica
I20260812 17:59:56.138618 17557 raft_consensus.cc:2229] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 2 LEADER]: Raft consensus shutting down.
I20260812 17:59:56.139217 17557 raft_consensus.cc:2258] T 6611f2f6d1d94bf0951c75e37d04183d P 3378cfbec710463b803ce07c6e06ecac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:56.156461 17557 tablet_server.cc:194] TabletServer@127.17.37.67:0 shutdown complete.
I20260812 17:59:56.163169 17557 master.cc:537] Master@127.17.37.126:46343 shutting down...
I20260812 17:59:56.176090 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:56.176519 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:56.176819 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P beb79ec8bcd945838d04e0db94835e39: stopping tablet replica
I20260812 17:59:56.193015 17557 master.cc:552] Master@127.17.37.126:46343 shutdown complete.
[ OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (5126 ms)
[ RUN ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260812 17:59:56.215039 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:32825
I20260812 17:59:56.215914 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:56.220525 18991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.221499 18992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.223556 18996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.223623 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:56.224350 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.224529 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.224689 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596224675 us; error 0 us; skew 500 ppm
I20260812 17:59:56.225157 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.227181 17557 webserver.cc:460] Webserver started at http://127.17.37.126:33431/ using document root <none> and password file <none>
I20260812 17:59:56.227646 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.227840 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:56.228097 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:56.229013 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "8561904dfe9c4e358764c959bd3d659e"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.232904 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 17:59:56.235679 19001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.236310 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:59:56.236555 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "8561904dfe9c4e358764c959bd3d659e"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.236835 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.257778 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.258769 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:56.292162 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:32825
I20260812 17:59:56.292315 19059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:32825 every 8 connection(s)
I20260812 17:59:56.295720 19060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:56.304334 19060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e: Bootstrap starting.
I20260812 17:59:56.308166 19060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:56.311815 19060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e: No bootstrap required, opened a new log
I20260812 17:59:56.313529 19060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER }
I20260812 17:59:56.313933 19060 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:56.314114 19060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8561904dfe9c4e358764c959bd3d659e, State: Initialized, Role: FOLLOWER
I20260812 17:59:56.314640 19060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER }
I20260812 17:59:56.315030 19060 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:59:56.315235 19060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:59:56.315478 19060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:56.319242 19060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER }
I20260812 17:59:56.319687 19060 leader_election.cc:302] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8561904dfe9c4e358764c959bd3d659e; no voters:
I20260812 17:59:56.320786 19060 leader_election.cc:288] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:59:56.321067 19063 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:56.322391 19063 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 1 LEADER]: Becoming Leader. State: Replica: 8561904dfe9c4e358764c959bd3d659e, State: Running, Role: LEADER
I20260812 17:59:56.322944 19063 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER }
I20260812 17:59:56.323385 19060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:56.325315 19064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8561904dfe9c4e358764c959bd3d659e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER } }
I20260812 17:59:56.325244 19066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8561904dfe9c4e358764c959bd3d659e. Latest consensus state: current_term: 1 leader_uuid: "8561904dfe9c4e358764c959bd3d659e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8561904dfe9c4e358764c959bd3d659e" member_type: VOTER } }
I20260812 17:59:56.325803 19064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:56.325969 19066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:56.328709 19070 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:56.332904 19070 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:56.336975 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:56.340415 19070 catalog_manager.cc:1347] Generated new cluster ID: e2b530b20edd4243887b5cd0ab45f2ba
I20260812 17:59:56.340608 19070 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:56.375752 19070 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:56.377409 19070 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:56.390592 19070 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e: Generated new TSK 0
I20260812 17:59:56.391095 19070 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:56.403548 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:56.408771 19087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.409947 19088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.412223 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:56.412388 19090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.413232 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.413405 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.413569 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596413534 us; error 0 us; skew 500 ppm
I20260812 17:59:56.414074 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.416080 17557 webserver.cc:460] Webserver started at http://127.17.37.65:40209/ using document root <none> and password file <none>
I20260812 17:59:56.416581 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.416780 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:56.417047 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:56.418206 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "057589ff80224823b840a420475780fe"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.421993 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:59:56.424917 19096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.425516 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:59:56.425748 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "057589ff80224823b840a420475780fe"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.426076 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.436583 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.437702 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:56.439131 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:56.441181 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:56.441341 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.441630 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:56.441778 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.478312 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:37417
I20260812 17:59:56.478396 19172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:37417 every 8 connection(s)
I20260812 17:59:56.492749 19173 heartbeater.cc:347] Connected to a master server at 127.17.37.126:32825
I20260812 17:59:56.493060 19173 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:56.493613 19173 heartbeater.cc:511] Master 127.17.37.126:32825 requested a full tablet report, sending...
I20260812 17:59:56.495350 19019 ts_manager.cc:194] Registered new tserver with Master: 057589ff80224823b840a420475780fe (127.17.37.65:37417)
I20260812 17:59:56.495757 17557 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.014522525s
I20260812 17:59:56.497107 19019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48382
I20260812 17:59:56.514490 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 17:59:56.529142 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:56.544269 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 17:59:56.551162 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:59:56.553697 17557 tablet_server.cc:93] deduplicated master addresses: 127.17.37.126:32825
W20260812 17:59:56.556753 19186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.558202 19187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.558336 19191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.558557 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:56.559598 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.559829 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.560003 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596559982 us; error 0 us; skew 500 ppm
I20260812 17:59:56.560498 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.562644 17557 webserver.cc:460] Webserver started at http://127.17.37.65:40209/ using document root <none> and password file <none>
I20260812 17:59:56.563119 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.563308 17557 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260812 17:59:56.566393 17557 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:59:56.568718 19196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.569367 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:59:56.569624 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "057589ff80224823b840a420475780fe"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.569953 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.591101 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.592095 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:56.593447 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:56.595472 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:56.595672 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.595880 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:56.596052 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.640638 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:37417
I20260812 17:59:56.640710 19273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:37417 every 8 connection(s)
I20260812 17:59:56.646323 17557 tablet_server.cc:178] TabletServer@127.17.37.65:37417 shutting down...
I20260812 17:59:56.661154 19274 heartbeater.cc:347] Connected to a master server at 127.17.37.126:32825
I20260812 17:59:56.661583 19274 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:56.662416 19274 heartbeater.cc:511] Master 127.17.37.126:32825 requested a full tablet report, sending...
I20260812 17:59:56.664605 19019 ts_manager.cc:194] Re-registered known tserver with Master: 057589ff80224823b840a420475780fe (127.17.37.65:37417)
I20260812 17:59:56.666581 19019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48400
I20260812 17:59:56.672053 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 17:59:56.687292 17557 tablet_server.cc:194] TabletServer@127.17.37.65:37417 shutdown complete.
I20260812 17:59:56.693951 17557 master.cc:537] Master@127.17.37.126:32825 shutting down...
I20260812 17:59:56.708931 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:59:56.709357 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:59:56.709717 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8561904dfe9c4e358764c959bd3d659e: stopping tablet replica
I20260812 17:59:56.728348 17557 master.cc:552] Master@127.17.37.126:32825 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (533 ms)
[ RUN ] TsTabletManagerITest.TestTableStats
I20260812 17:59:56.748909 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:41863,127.17.37.125:34381,127.17.37.124:44431
I20260812 17:59:56.750129 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:56.754668 19283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.755685 19284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.757470 19287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.758771 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:56.759408 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.759567 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.759753 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596759722 us; error 0 us; skew 500 ppm
I20260812 17:59:56.760272 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.762535 17557 webserver.cc:460] Webserver started at http://127.17.37.126:39499/ using document root <none> and password file <none>
I20260812 17:59:56.762952 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.763137 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:56.763413 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:56.764467 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "2990073d5e564f0383a43b2f0dea89de"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.768513 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:59:56.771381 19294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.772059 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:59:56.772372 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "2990073d5e564f0383a43b2f0dea89de"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.772665 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.796389 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.797324 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:56.830783 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:41863
I20260812 17:59:56.830875 19356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:41863 every 8 connection(s)
I20260812 17:59:56.834444 19357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:56.834635 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:56.840088 19359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.841873 19357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } has no permanent_uuid. Determining permanent_uuid...
W20260812 17:59:56.842581 19360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.843168 19362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.844384 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:56.846060 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.846247 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.846455 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596846438 us; error 0 us; skew 500 ppm
I20260812 17:59:56.847170 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.849599 17557 webserver.cc:460] Webserver started at http://127.17.37.125:41201/ using document root <none> and password file <none>
I20260812 17:59:56.850028 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.850208 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:56.850482 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:56.851670 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-1-root/instance:
uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.856460 19357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:56.857172 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
W20260812 17:59:56.858525 19299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.37.125:34381: connect: Connection refused (error 111)
I20260812 17:59:56.860817 19373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260812 17:59:56.861291 19357 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.125:34381: Network error: Client connection negotiation failed: client connection to 127.17.37.125:34381: connect: Connection refused (error 111)
I20260812 17:59:56.861617 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:59:56.861917 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-1-root
uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.862169 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.881937 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.882812 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:56.899777 19357 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } attempt: 1
W20260812 17:59:56.903993 19357 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.125:34381: Network error: Client connection negotiation failed: client connection to 127.17.37.125:34381: connect: Connection refused (error 111)
I20260812 17:59:56.917491 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.125:34381
I20260812 17:59:56.917586 19438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.125:34381 every 8 connection(s)
I20260812 17:59:56.920948 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:59:56.921197 19439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 17:59:56.927044 19441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:56.927274 19442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.929150 19439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } has no permanent_uuid. Determining permanent_uuid...
W20260812 17:59:56.933121 19444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:56.933403 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:56.934489 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:56.934731 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:56.934913 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557596934900 us; error 0 us; skew 500 ppm
I20260812 17:59:56.935539 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:56.938287 17557 webserver.cc:460] Webserver started at http://127.17.37.124:42105/ using document root <none> and password file <none>
I20260812 17:59:56.938858 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:56.939087 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:56.939352 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:56.940634 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-2-root/instance:
uuid: "6de0955b56fd46699c03a928f7c2bb23"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.943862 19439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:56.944471 19357 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } attempt: 2
I20260812 17:59:56.947216 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 17:59:56.951908 19455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:56.952986 17557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 17:59:56.953276 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-2-root
uuid: "6de0955b56fd46699c03a928f7c2bb23"
format_stamp: "Formatted at 2026-08-12 17:59:56 on dist-test-slave-6nmv"
I20260812 17:59:56.953563 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:56.963060 19439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:56.966491 19357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } has no permanent_uuid. Determining permanent_uuid...
W20260812 17:59:56.968261 19439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.124:44431: Network error: Client connection negotiation failed: client connection to 127.17.37.124:44431: connect: Connection refused (error 111)
W20260812 17:59:56.970526 19357 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.124:44431: Network error: Client connection negotiation failed: client connection to 127.17.37.124:44431: connect: Connection refused (error 111)
I20260812 17:59:56.984218 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:56.985167 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:57.003742 19439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } attempt: 1
I20260812 17:59:57.004027 19357 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } attempt: 1
W20260812 17:59:57.008567 19439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.124:44431: Network error: Client connection negotiation failed: client connection to 127.17.37.124:44431: connect: Connection refused (error 111)
W20260812 17:59:57.008787 19357 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.37.124:44431: Network error: Client connection negotiation failed: client connection to 127.17.37.124:44431: connect: Connection refused (error 111)
I20260812 17:59:57.022400 19514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.124:44431 every 8 connection(s)
I20260812 17:59:57.109855 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.124:44431
I20260812 17:59:57.114058 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 17:59:57.115121 19516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.123335 19516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:57.137619 19357 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } attempt: 2
I20260812 17:59:57.146203 19516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:57.158360 19516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:59:57.158861 19357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: Bootstrap starting.
I20260812 17:59:57.163889 19357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.167655 19439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } attempt: 2
I20260812 17:59:57.168480 19357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: No bootstrap required, opened a new log
I20260812 17:59:57.171125 19357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.171882 19357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.172228 19357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2990073d5e564f0383a43b2f0dea89de, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.173022 19357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.175184 19522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.176036 19522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.176759 19357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:57.178669 19516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: Bootstrap starting.
I20260812 17:59:57.184670 19516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.190253 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260812 17:59:57.191365 19439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Bootstrap starting.
I20260812 17:59:57.192667 19516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: No bootstrap required, opened a new log
W20260812 17:59:57.193468 19535 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:59:57.193768 19535 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:59:57.195097 19516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.195832 19516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.196089 19516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de0955b56fd46699c03a928f7c2bb23, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.196818 19439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.196792 19516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.198845 19536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.199409 19536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.200400 19516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:57.201683 19439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: No bootstrap required, opened a new log
I20260812 17:59:57.204393 19439 raft_consensus.cc:348] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.205242 19439 raft_consensus.cc:374] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.205569 19439 raft_consensus.cc:729] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.206414 19439 consensus_queue.cc:260] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.208305 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.209177 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.209686 19544 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:57.210492 19439 sys_catalog.cc:564] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:59:57.210275 19544 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.214104 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 17:59:57.214799 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 0.
I20260812 17:59:57.215557 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 17:59:57.216711 19486 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 0.
I20260812 17:59:57.216786 19377 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0; no voters:
I20260812 17:59:57.215863 19544 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 17:59:57.220120 19548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:57.220682 19548 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:57.221061 19548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:57.229348 19548 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:57.232942 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de"
I20260812 17:59:57.233538 19326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:57.233919 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23"
I20260812 17:59:57.234647 19486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 0 FOLLOWER]: Advancing to term 1
W20260812 17:59:57.236064 19567 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:59:57.236375 19567 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:59:57.237438 19548 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 1 election: Requested vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 17:59:57.239014 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260812 17:59:57.240396 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 1.
I20260812 17:59:57.240902 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:59:57.241425 19377 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0; no voters:
I20260812 17:59:57.242262 19548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:57.242667 19548 raft_consensus.cc:686] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 LEADER]: Becoming Leader. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
W20260812 17:59:57.243221 19569 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 17:59:57.243343 19486 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 1.
W20260812 17:59:57.243522 19569 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:59:57.243494 19548 consensus_queue.cc:237] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
W20260812 17:59:57.248705 19572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:57.249927 19573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.254801 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:57.254669 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
W20260812 17:59:57.255383 19576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.255540 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:57.256618 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:57.256928 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:57.257151 19578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:59:57.257138 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557597257119 us; error 0 us; skew 500 ppm
I20260812 17:59:57.258109 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:57.261029 17557 webserver.cc:460] Webserver started at http://127.17.37.65:36855/ using document root <none> and password file <none>
I20260812 17:59:57.261624 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:57.261883 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:57.262295 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:57.263744 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "7006590bc9d14fed9b0239a1513d0a41"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.263897 19578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:59:57.270469 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 17:59:57.273048 19486 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Refusing update from remote peer a653ad9dc1a84e9c9f052e31970f1ea0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:59:57.273725 19326 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Refusing update from remote peer a653ad9dc1a84e9c9f052e31970f1ea0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:59:57.274507 19544 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:57.275451 19583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.275399 19548 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:57.276407 17557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:59:57.276794 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "7006590bc9d14fed9b0239a1513d0a41"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.277196 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:57.285202 19536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.286266 19536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.289781 19522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.290755 19522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.294425 19536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.295511 19536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.304773 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.305778 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:57.309705 19522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.310839 19522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:59:57.309980 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 17:59:57.311197 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:59:57.311421 19578 catalog_manager.cc:1347] Generated new cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 17:59:57.311750 19578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:59:57.315223 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:57.316195 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:57.317638 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:57.319953 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:57.320227 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.320453 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:57.320613 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.333273 19578 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:59:57.335940 19578 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:59:57.359915 19578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Generated new TSK 0
I20260812 17:59:57.360783 19578 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:59:57.389307 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:37193
I20260812 17:59:57.389367 19674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:37193 every 8 connection(s)
I20260812 17:59:57.409497 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:59:57.417888 19677 heartbeater.cc:347] Connected to a master server at 127.17.37.125:34381
I20260812 17:59:57.418324 19677 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.418725 19676 heartbeater.cc:347] Connected to a master server at 127.17.37.124:44431
I20260812 17:59:57.419142 19677 heartbeater.cc:511] Master 127.17.37.125:34381 requested a full tablet report, sending...
I20260812 17:59:57.419194 19676 heartbeater.cc:464] Registering TS with master...
W20260812 17:59:57.419438 19683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.420382 19676 heartbeater.cc:511] Master 127.17.37.124:44431 requested a full tablet report, sending...
I20260812 17:59:57.421692 19393 ts_manager.cc:194] Registered new tserver with Master: 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 17:59:57.422385 19684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.423900 19473 ts_manager.cc:194] Registered new tserver with Master: 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:57.424690 19393 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57366
I20260812 17:59:57.429402 17557 server_base.cc:1034] running on GCE node
W20260812 17:59:57.430518 19686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.431650 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:57.431945 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:57.432201 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557597432182 us; error 0 us; skew 500 ppm
I20260812 17:59:57.432488 19678 heartbeater.cc:347] Connected to a master server at 127.17.37.126:41863
I20260812 17:59:57.432852 19678 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.432920 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:57.433612 19678 heartbeater.cc:511] Master 127.17.37.126:41863 requested a full tablet report, sending...
I20260812 17:59:57.435788 17557 webserver.cc:460] Webserver started at http://127.17.37.66:33979/ using document root <none> and password file <none>
I20260812 17:59:57.436277 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:57.436286 19315 ts_manager.cc:194] Registered new tserver with Master: 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:57.436512 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:57.436847 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:57.438094 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "35ff99af114a416382c1389003b046ef"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.442327 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:59:57.445362 19691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.446125 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 17:59:57.446429 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "35ff99af114a416382c1389003b046ef"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.446696 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:57.462621 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:57.463768 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:57.464926 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:57.467443 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:57.467658 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.467886 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:57.468050 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.529193 19677 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 17:59:57.548290 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:39971
I20260812 17:59:57.548436 19773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:39971 every 8 connection(s)
I20260812 17:59:57.563529 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:59:57.576901 19784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:59:57.580281 19783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.581491 19775 heartbeater.cc:347] Connected to a master server at 127.17.37.125:34381
I20260812 17:59:57.582227 19775 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.583248 19775 heartbeater.cc:511] Master 127.17.37.125:34381 requested a full tablet report, sending...
I20260812 17:59:57.586087 19393 ts_manager.cc:194] Registered new tserver with Master: 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:57.586221 17557 server_base.cc:1034] running on GCE node
I20260812 17:59:57.586560 19774 heartbeater.cc:347] Connected to a master server at 127.17.37.124:44431
I20260812 17:59:57.587021 19774 heartbeater.cc:464] Registering TS with master...
W20260812 17:59:57.587173 19788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:59:57.588121 19774 heartbeater.cc:511] Master 127.17.37.124:44431 requested a full tablet report, sending...
I20260812 17:59:57.588266 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 17:59:57.588606 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 17:59:57.588543 19393 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57378
I20260812 17:59:57.588903 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557597588884 us; error 0 us; skew 500 ppm
I20260812 17:59:57.589653 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 17:59:57.590003 19777 heartbeater.cc:347] Connected to a master server at 127.17.37.126:41863
I20260812 17:59:57.590421 19777 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.591476 19473 ts_manager.cc:194] Registered new tserver with Master: 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:57.591764 19777 heartbeater.cc:511] Master 127.17.37.126:41863 requested a full tablet report, sending...
I20260812 17:59:57.594528 19315 ts_manager.cc:194] Registered new tserver with Master: 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:57.595821 17557 webserver.cc:460] Webserver started at http://127.17.37.67:42851/ using document root <none> and password file <none>
I20260812 17:59:57.596271 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 17:59:57.596423 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:59:57.596619 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:59:57.597597 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-2-root/instance:
uuid: "fdc12507efa14578bf950e82f27ce9d1"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.602581 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:59:57.606199 19793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.606992 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 17:59:57.607280 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-2-root
uuid: "fdc12507efa14578bf950e82f27ce9d1"
format_stamp: "Formatted at 2026-08-12 17:59:57 on dist-test-slave-6nmv"
I20260812 17:59:57.607573 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:59:57.620954 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:59:57.622188 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:59:57.624284 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:59:57.627194 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:59:57.627421 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.627663 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:59:57.627831 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:59:57.692586 19775 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 17:59:57.703480 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.67:43837
I20260812 17:59:57.703575 19872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.67:43837 every 8 connection(s)
I20260812 17:59:57.729663 19873 heartbeater.cc:347] Connected to a master server at 127.17.37.124:44431
I20260812 17:59:57.730098 19873 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.730341 19876 heartbeater.cc:347] Connected to a master server at 127.17.37.125:34381
I20260812 17:59:57.730619 19876 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.730891 19873 heartbeater.cc:511] Master 127.17.37.124:44431 requested a full tablet report, sending...
I20260812 17:59:57.731248 19876 heartbeater.cc:511] Master 127.17.37.125:34381 requested a full tablet report, sending...
I20260812 17:59:57.733355 19393 ts_manager.cc:194] Registered new tserver with Master: fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:57.734651 19473 ts_manager.cc:194] Registered new tserver with Master: fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:57.735296 19393 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57380
I20260812 17:59:57.738169 19878 heartbeater.cc:347] Connected to a master server at 127.17.37.126:41863
I20260812 17:59:57.738497 19878 heartbeater.cc:464] Registering TS with master...
I20260812 17:59:57.739157 19878 heartbeater.cc:511] Master 127.17.37.126:41863 requested a full tablet report, sending...
I20260812 17:59:57.741058 19315 ts_manager.cc:194] Registered new tserver with Master: fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:57.742111 17557 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023599744s
I20260812 17:59:57.784610 19393 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260812 17:59:57.786196 19393 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:59:57.839180 19876 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 17:59:57.857530 19727 tablet_service.cc:1467] Processing CreateTablet for tablet 77412e40b9514520873b174d5415031f (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.858883 19727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77412e40b9514520873b174d5415031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.861904 19726 tablet_service.cc:1467] Processing CreateTablet for tablet ec9e64e7058844429592e9e754c776e7 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.863236 19726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec9e64e7058844429592e9e754c776e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.866430 19831 tablet_service.cc:1467] Processing CreateTablet for tablet 77412e40b9514520873b174d5415031f (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.867681 19831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77412e40b9514520873b174d5415031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.867821 19830 tablet_service.cc:1467] Processing CreateTablet for tablet ec9e64e7058844429592e9e754c776e7 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.869277 19830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec9e64e7058844429592e9e754c776e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.875664 19724 tablet_service.cc:1467] Processing CreateTablet for tablet 643c7507a97e4279b5eda86d161734a2 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.880780 19724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643c7507a97e4279b5eda86d161734a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.881184 19829 tablet_service.cc:1467] Processing CreateTablet for tablet 643c7507a97e4279b5eda86d161734a2 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.884714 19633 tablet_service.cc:1467] Processing CreateTablet for tablet 77412e40b9514520873b174d5415031f (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.887409 19829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643c7507a97e4279b5eda86d161734a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.887810 19633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77412e40b9514520873b174d5415031f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.890472 19632 tablet_service.cc:1467] Processing CreateTablet for tablet ec9e64e7058844429592e9e754c776e7 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.892650 19632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec9e64e7058844429592e9e754c776e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.893268 19631 tablet_service.cc:1467] Processing CreateTablet for tablet 643c7507a97e4279b5eda86d161734a2 (DEFAULT_TABLE table=test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260812 17:59:57.895071 19901 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: Bootstrap starting.
I20260812 17:59:57.896185 19631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643c7507a97e4279b5eda86d161734a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:59:57.920879 19901 tablet_bootstrap.cc:654] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.933151 19902 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: Bootstrap starting.
I20260812 17:59:57.938619 19902 tablet_bootstrap.cc:654] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.940016 19901 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: No bootstrap required, opened a new log
I20260812 17:59:57.940476 19901 ts_tablet_manager.cc:1397] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.005s
I20260812 17:59:57.940572 19903 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Bootstrap starting.
I20260812 17:59:57.943188 19901 raft_consensus.cc:348] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:57.943915 19901 raft_consensus.cc:374] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.944198 19901 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.945171 19901 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:57.946461 19903 tablet_bootstrap.cc:654] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.953186 19903 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: No bootstrap required, opened a new log
I20260812 17:59:57.953526 19901 ts_tablet_manager.cc:1428] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: Time spent starting tablet: real 0.013s user 0.005s sys 0.005s
I20260812 17:59:57.953625 19903 ts_tablet_manager.cc:1397] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260812 17:59:57.956391 19903 raft_consensus.cc:348] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:57.957218 19903 raft_consensus.cc:374] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.957522 19903 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.958366 19903 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:57.961946 19902 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: No bootstrap required, opened a new log
I20260812 17:59:57.962697 19901 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: Bootstrap starting.
I20260812 17:59:57.962641 19902 ts_tablet_manager.cc:1397] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.007s
I20260812 17:59:57.967118 19902 raft_consensus.cc:348] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:57.968209 19902 raft_consensus.cc:374] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:57.968637 19902 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Initialized, Role: FOLLOWER
I20260812 17:59:57.969539 19901 tablet_bootstrap.cc:654] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.969542 19902 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:57.976359 19903 ts_tablet_manager.cc:1428] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Time spent starting tablet: real 0.022s user 0.017s sys 0.004s
I20260812 17:59:57.977496 19903 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: Bootstrap starting.
I20260812 17:59:57.983927 19903 tablet_bootstrap.cc:654] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:57.985526 19902 ts_tablet_manager.cc:1428] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: Time spent starting tablet: real 0.022s user 0.008s sys 0.006s
I20260812 17:59:57.988950 19905 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:57.989562 19905 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:57.992865 19905 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:57.996536 19902 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: Bootstrap starting.
I20260812 17:59:57.999763 19903 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: No bootstrap required, opened a new log
I20260812 17:59:58.000285 19903 ts_tablet_manager.cc:1397] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.008s
I20260812 17:59:58.003172 19903 raft_consensus.cc:348] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.003849 19903 raft_consensus.cc:374] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.004186 19903 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.005566 19903 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.008335 19902 tablet_bootstrap.cc:654] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:58.021425 19902 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: No bootstrap required, opened a new log
I20260812 17:59:58.022142 19902 ts_tablet_manager.cc:1397] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.006s
I20260812 17:59:58.025673 19902 raft_consensus.cc:348] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.026911 19902 raft_consensus.cc:374] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.027379 19902 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.028429 19902 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.037335 19902 ts_tablet_manager.cc:1428] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: Time spent starting tablet: real 0.015s user 0.007s sys 0.001s
I20260812 17:59:58.043495 19910 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.044057 19910 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:58.050719 19910 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:58.052881 19902 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: Bootstrap starting.
I20260812 17:59:58.072918 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:58.074689 19742 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 0.
I20260812 17:59:58.083091 19909 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.085354 19909 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.087697 19909 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.088557 19909 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.090503 19902 tablet_bootstrap.cc:654] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:58.090305 19910 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.094421 19910 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.089114 19909 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.100275 19910 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:58.103653 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:58.104497 19910 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:58.104883 19910 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:58.104557 19903 ts_tablet_manager.cc:1428] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: Time spent starting tablet: real 0.104s user 0.030s sys 0.043s
I20260812 17:59:58.105234 19910 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.106841 19909 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.107438 19903 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: Bootstrap starting.
I20260812 17:59:58.107409 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.107584 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
W20260812 17:59:58.110152 19798 leader_election.cc:341] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Illegal state: must be running to vote when last-logged opid is not known
I20260812 17:59:58.113245 19901 tablet_bootstrap.cc:492] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: No bootstrap required, opened a new log
I20260812 17:59:58.113672 19901 ts_tablet_manager.cc:1397] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: Time spent bootstrapping tablet: real 0.151s user 0.054s sys 0.048s
I20260812 17:59:58.117599 19910 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:58.119324 19844 raft_consensus.cc:2379] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef in current term 1: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 17:59:58.121114 19910 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:58.123008 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 17:59:58.126138 19742 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Advancing to term 1
W20260812 17:59:58.126796 19509 debug-util.cc:398] Leaking SignalData structure 0x7b08000a77e0 after lost signal to thread 17562
I20260812 17:59:58.137265 19742 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 1.
I20260812 17:59:58.148690 19901 raft_consensus.cc:348] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.150813 19901 raft_consensus.cc:374] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.151104 19901 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.154583 19903 tablet_bootstrap.cc:654] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:58.155409 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:58.151122 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:58.157521 19910 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:58.155771 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:58.155839 19901 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.162106 19901 ts_tablet_manager.cc:1428] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: Time spent starting tablet: real 0.048s user 0.010s sys 0.006s
I20260812 17:59:58.162833 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:58.163481 19642 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 0.
I20260812 17:59:58.170042 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
W20260812 17:59:58.173527 19798 leader_election.cc:341] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Illegal state: must be running to vote when last-logged opid is not known
W20260812 17:59:58.174607 19798 leader_election.cc:341] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Illegal state: must be running to vote when last-logged opid is not known
W20260812 17:59:58.177640 19695 leader_election.cc:341] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Illegal state: must be running to vote when last-logged opid is not known
I20260812 17:59:58.178166 19902 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: No bootstrap required, opened a new log
I20260812 17:59:58.178742 19902 ts_tablet_manager.cc:1397] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.004s
I20260812 17:59:58.178158 19695 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:58.175702 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 17:59:58.181584 19901 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: Bootstrap starting.
I20260812 17:59:58.182327 19905 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 17:59:58.201413 19535 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 17:59:58.201921 19535 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: loading cluster ID for follower catalog manager: success
I20260812 17:59:58.207621 19910 raft_consensus.cc:686] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 17:59:58.208881 19923 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:58.209219 19923 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:58.209504 19923 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.209457 19910 consensus_queue.cc:237] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:58.219897 19902 raft_consensus.cc:348] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.223834 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.224578 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.226608 19535 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: acquiring CA information for follower catalog manager: success
I20260812 17:59:58.223191 19902 raft_consensus.cc:374] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.230082 19902 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.230824 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.230816 19902 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.231418 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.231937 19844 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 0.
I20260812 17:59:58.233443 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.236343 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:58.237653 19909 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:58.238047 19909 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:58.233686 19923 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.239343 19909 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.239880 19843 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 1: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 17:59:58.241858 19902 ts_tablet_manager.cc:1428] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: Time spent starting tablet: real 0.063s user 0.008s sys 0.000s
I20260812 17:59:58.243294 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:58.243919 19642 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 0.
I20260812 17:59:58.244776 19535 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:59:58.243872 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.247295 19843 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef in current term 1: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 17:59:58.245659 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 17:59:58.248700 19905 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:59:58.249799 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:58.250222 19905 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.250502 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:58.257099 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 17:59:58.259805 19642 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.256016 19923 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:58.262804 19909 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.265218 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:58.266070 19741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:58.269454 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
W20260812 17:59:58.271392 19598 leader_election.cc:341] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Illegal state: must be running to vote when last-logged opid is not known
I20260812 17:59:58.273007 19901 tablet_bootstrap.cc:654] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: Neither blocks nor log segments found. Creating new log.
I20260812 17:59:58.273011 19741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 17:59:58.273973 19909 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
W20260812 17:59:58.275830 19598 leader_election.cc:341] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Illegal state: must be running to vote when last-logged opid is not known
I20260812 17:59:58.269009 19567 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 17:59:58.278437 19567 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: loading cluster ID for follower catalog manager: success
I20260812 17:59:58.280474 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:58.287906 19392 catalog_manager.cc:5495] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67). New cstate: current_term: 1 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:58.286628 19843 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.291318 19642 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 1.
I20260812 17:59:58.292420 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:58.293176 19914 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 17:59:58.294008 19923 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:58.294842 19923 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 17:59:58.295629 19923 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.300514 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.301646 19742 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fdc12507efa14578bf950e82f27ce9d1 in current term 1: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 17:59:58.286438 19903 tablet_bootstrap.cc:492] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: No bootstrap required, opened a new log
I20260812 17:59:58.309796 19903 ts_tablet_manager.cc:1397] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: Time spent bootstrapping tablet: real 0.203s user 0.009s sys 0.017s
I20260812 17:59:58.312930 19903 raft_consensus.cc:348] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:58.313593 19903 raft_consensus.cc:374] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.317951 19903 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.318658 19903 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
W20260812 17:59:58.319331 19798 consensus_peers.cc:487] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 17:59:58.320703 19903 ts_tablet_manager.cc:1428] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260812 17:59:58.323561 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 1.
I20260812 17:59:58.324019 19914 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.324443 19914 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:58.326457 19914 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.329883 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 17:59:58.330750 19914 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:59:58.331228 19914 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 LEADER]: Becoming Leader. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 17:59:58.332013 19914 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.332536 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:58.333288 19742 raft_consensus.cc:2379] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 1: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 17:59:58.335160 19923 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:58.339915 19392 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67). New cstate: current_term: 1 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: HEALTHY } } }
I20260812 17:59:58.341809 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.342549 19567 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: acquiring CA information for follower catalog manager: success
I20260812 17:59:58.343709 19901 tablet_bootstrap.cc:492] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: No bootstrap required, opened a new log
I20260812 17:59:58.344163 19901 ts_tablet_manager.cc:1397] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: Time spent bootstrapping tablet: real 0.163s user 0.019s sys 0.006s
I20260812 17:59:58.344218 19592 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:58.346719 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.347024 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:58.347393 19909 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.349439 19901 raft_consensus.cc:348] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.350442 19901 raft_consensus.cc:374] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:59:58.350844 19901 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Initialized, Role: FOLLOWER
I20260812 17:59:58.351724 19901 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.354669 19901 ts_tablet_manager.cc:1428] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260812 17:59:58.356159 19567 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:59:58.356288 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:58.357465 19642 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef in current term 1: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 17:59:58.356606 19909 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 17:59:58.358599 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:58.359421 19932 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 17:59:58.403371 19932 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:58.403893 19932 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.405936 19932 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.410558 19923 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:58.411195 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:58.413669 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:58.412310 19843 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef in current term 1: Already voted for candidate 7006590bc9d14fed9b0239a1513d0a41 in this term.
I20260812 17:59:58.423309 19692 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:58.424271 19932 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:59:58.422371 19923 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 17:59:58.432390 19932 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 17:59:58.446188 19914 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:59:58.461392 19914 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 17:59:58.493561 19391 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65). New cstate: current_term: 1 leader_uuid: "7006590bc9d14fed9b0239a1513d0a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:58.730675 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:58.731252 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.734892 19946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 17:59:58.735450 19946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 17:59:58.737432 19946 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 17:59:58.738790 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 17:59:58.739048 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 17:59:58.740454 19299 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de; no voters: 6de0955b56fd46699c03a928f7c2bb23, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 17:59:58.741981 19946 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:58.744481 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:58.794405 19947 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 17:59:58.795084 19947 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.806989 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:58.830111 19947 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 17:59:58.994217 19932 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 17:59:58.994822 19932 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:58.997790 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:59.006058 19914 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.006817 19914 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.009366 19932 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.012498 19914 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.014096 19932 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.014654 19932 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.024255 19932 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:59.025014 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:59.025663 19642 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 1.
I20260812 17:59:59.026758 19695 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 17:59:59.029625 19932 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:59:59.030011 19932 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.030448 19932 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.035492 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:59.037501 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
W20260812 17:59:59.038698 19737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46168 (request call id 8) took 261 ms (client timeout 256 ms). Trace:
I20260812 17:59:59.039220 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
W20260812 17:59:59.039161 19737 rpcz_store.cc:269] 0812 17:59:58.776846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 17:59:59.038409 (+261563us) service_pool.cc:214] Skipping call since client already timed out
0812 17:59:59.038631 (+ 222us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 17:59:59.040117 19742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 14) took 211 ms (client timeout 253 ms). Trace:
I20260812 17:59:59.040602 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.042256 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.043560 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
W20260812 17:59:59.040505 19742 rpcz_store.cc:269] 0812 17:59:58.828461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 17:59:59.038965 (+210504us) service_pool.cc:227] Handling call
0812 17:59:59.040064 (+ 1099us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 17:59:59.046178 19735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:59.047796 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.046419 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.050335 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.052361 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.049467 19692 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.054610 19735 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 1.
I20260812 17:59:59.056293 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:59.056589 19905 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.056753 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.058800 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 17:59:59.059939 19692 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.060714 19950 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.061713 19905 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.069895 19932 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.071472 19734 raft_consensus.cc:2379] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 2: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 17:59:59.072062 19932 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Requested vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:59.072896 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:59.074074 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:59.076774 19695 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.078089 19932 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.086648 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.087508 19914 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:59:59.087875 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.088251 19914 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.094939 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.096200 19737 raft_consensus.cc:1226] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Rejecting Update request from peer fdc12507efa14578bf950e82f27ce9d1 for earlier term 1. Current term is 2. Ops: []
I20260812 17:59:59.097115 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.099435 19598 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.101260 19914 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.101868 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:59.104153 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 17:59:59.107079 19947 consensus_queue.cc:1046] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260812 17:59:59.108019 19914 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.107518 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 17:59:59.109696 19914 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 17:59:59.112300 19950 raft_consensus.cc:3032] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 17:59:59.112668 19950 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 17:59:59.113478 19950 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.114907 19950 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.180617 19642 raft_consensus.cc:1226] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Rejecting Update request from peer fdc12507efa14578bf950e82f27ce9d1 for earlier term 1. Current term is 2. Ops: []
I20260812 17:59:59.184199 19950 consensus_queue.cc:1046] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:59.185050 19947 raft_consensus.cc:3032] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 17:59:59.185401 19947 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 17:59:59.186203 19947 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.187145 19947 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.323796 19932 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:59.324297 19932 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.326182 19932 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:59.328418 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:59.329079 19642 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 17:59:59.330255 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.331108 19844 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 17:59:59.330327 19695 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 17:59:59.332435 19932 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 17:59:59.332862 19932 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:59.333042 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.333254 19932 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.333950 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.335999 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.338274 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 17:59:59.338852 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:59:59.339497 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.340785 19932 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.341342 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.342945 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 17:59:59.343195 19932 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 3 election: Requested vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 17:59:59.343556 19737 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 1.
I20260812 17:59:59.344599 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:59.345204 19843 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.345376 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.345994 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:59.346400 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 17:59:59.346611 19643 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.346030 19842 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 2.
I20260812 17:59:59.348233 19914 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 17:59:59.348675 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:59:59.349009 19914 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.351649 19843 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 3.
I20260812 17:59:59.352605 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 17:59:59.352909 19692 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:59.353875 19844 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 17:59:59.355734 19932 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader election won for term 3
I20260812 17:59:59.355899 19692 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:59.358067 19905 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:59:59.358400 19932 raft_consensus.cc:686] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 LEADER]: Becoming Leader. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 17:59:59.358503 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 17:59:59.359022 19905 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:59:59.359360 19932 consensus_queue.cc:237] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 17:59:59.362159 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.363235 19642 raft_consensus.cc:2354] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef for earlier term 2. Current term is 3.
I20260812 17:59:59.365190 19695 leader_election.cc:398] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193) with higher term. Message: Invalid argument: T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef for earlier term 2. Current term is 3.
I20260812 17:59:59.366808 19643 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 3.
I20260812 17:59:59.375205 19391 catalog_manager.cc:5495] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 1 to 3, leader changed from fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67) to 35ff99af114a416382c1389003b046ef (127.17.37.66). New cstate: current_term: 3 leader_uuid: "35ff99af114a416382c1389003b046ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:59.376351 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.377413 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:59.384411 19844 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.377702 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 17:59:59.404908 19844 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 3.
I20260812 17:59:59.406967 19592 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 17:59:59.408453 19909 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 17:59:59.418645 19909 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 LEADER]: Becoming Leader. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 17:59:59.419651 19909 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.438500 19388 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 1 to 3, leader changed from fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67) to 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65). New cstate: current_term: 3 leader_uuid: "7006590bc9d14fed9b0239a1513d0a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 17:59:59.382850 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 17:59:59.443373 19737 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:59:59.450728 19737 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 3.
I20260812 17:59:59.454905 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 17:59:59.456127 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 17:59:59.458649 19844 raft_consensus.cc:2354] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef for earlier term 2. Current term is 3.
I20260812 17:59:59.460039 19692 leader_election.cc:398] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Vote denied by peer fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837) with higher term. Message: Invalid argument: T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef for earlier term 2. Current term is 3.
I20260812 17:59:59.460376 19692 leader_election.cc:401] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 17:59:59.461030 19932 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837) with higher term. Message: Invalid argument: T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ff99af114a416382c1389003b046ef for earlier term 2. Current term is 3.
I20260812 17:59:59.453503 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 17:59:59.487620 19643 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 17:59:59.490788 19932 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:59.499078 19844 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 17:59:59.504861 19932 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260812 17:59:59.519455 19737 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 17:59:59.522065 19909 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 17:59:59.527655 19843 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260812 17:59:59.531299 19909 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 17:59:59.661638 19817 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:47132: Illegal state: replica fdc12507efa14578bf950e82f27ce9d1 is not leader of this config: current role FOLLOWER
W20260812 17:59:59.663355 19816 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:47132: Illegal state: replica fdc12507efa14578bf950e82f27ce9d1 is not leader of this config: current role FOLLOWER
W20260812 17:59:59.751114 19670 debug-util.cc:398] Leaking SignalData structure 0x7b080002d940 after lost signal to thread 17562
W20260812 17:59:59.752540 19670 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3ba0 after lost signal to thread 19356
W20260812 17:59:59.753602 19670 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3a00 after lost signal to thread 19438
W20260812 17:59:59.754662 19670 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1860 after lost signal to thread 19514
W20260812 18:00:00.095363 19886 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.17.37.65:37193, user_credentials={real_user=slave}} blocked reactor thread for 76430.6us
I20260812 18:00:00.199208 19643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7"
dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
from {username='slave'} at 127.0.0.1:40846
I20260812 18:00:00.199887 19643 raft_consensus.cc:580] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 LEADER]: Received request to step down
I20260812 18:00:00.200168 19643 raft_consensus.cc:3032] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 18:00:00.200443 19643 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:00.201185 19643 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.209904 19643 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:00.370496 19988 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.370993 19988 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.374982 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:00.373014 19988 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:00.380424 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:00.381026 19643 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 4.
I20260812 18:00:00.381991 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:00.382658 19988 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 18:00:00.383056 19988 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.383404 19988 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:00.388164 19988 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.390707 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:00.392089 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:00.393783 19988 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:00.423692 19642 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2"
dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
from {username='slave'} at 127.0.0.1:40846
I20260812 18:00:00.424340 19642 raft_consensus.cc:580] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 LEADER]: Received request to step down
I20260812 18:00:00.424713 19642 raft_consensus.cc:3032] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 18:00:00.424996 19642 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:00.425745 19642 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.427430 19642 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:00.430436 20003 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.432786 20003 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.436962 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:00.438844 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:00.439754 19737 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdc12507efa14578bf950e82f27ce9d1 in current term 4: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 18:00:00.443085 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:00.433918 19643 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 4.
I20260812 18:00:00.445546 20004 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:00.451848 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:00.452246 20003 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:00.453974 19988 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader election won for term 4
I20260812 18:00:00.454548 19988 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 LEADER]: Becoming Leader. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:00.455358 19988 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.478338 19391 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 3 to 4, leader changed from 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65) to 35ff99af114a416382c1389003b046ef (127.17.37.66). New cstate: current_term: 4 leader_uuid: "35ff99af114a416382c1389003b046ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:00.497967 20004 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:00.553074 20005 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.553720 20005 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.556130 20005 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:00.558107 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:00.559077 19643 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 18:00:00.558107 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:00.563580 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:00.564718 20005 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 18:00:00.565107 20005 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.565497 20005 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:00.566898 19643 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 18:00:00.568338 20004 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:00.568823 20004 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.570053 19905 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:00.570851 20004 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:00.572867 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:00.576510 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:00.577178 19643 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 2.
I20260812 18:00:00.583849 20005 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.585168 19737 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdc12507efa14578bf950e82f27ce9d1 in current term 2: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 18:00:00.590214 20005 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:00.591342 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:00.596702 19843 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:00.592203 19842 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260812 18:00:00.593466 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 18:00:00.593816 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:00.612802 20005 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:00.636173 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 18:00:00.636821 20004 raft_consensus.cc:2741] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260812 18:00:00.637661 19692 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:00.638815 19905 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Leader election won for term 2
I20260812 18:00:00.639439 19905 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 LEADER]: Becoming Leader. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:00.640216 19642 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 2.
I20260812 18:00:00.640331 19905 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.728468 20017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:00.729780 20017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:00.734970 20018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:00.735592 20018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:00.739058 20017 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:00.740772 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:00.757455 20018 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:00.763602 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:00.766803 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:00.767403 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:00.782167 19486 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2990073d5e564f0383a43b2f0dea89de in term 1.
I20260812 18:00:00.783090 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23; no voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:00.783876 19296 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23; no voters: a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:00.784701 20018 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 18:00:00.785086 20017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 18:00:00.785498 20017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Starting leader election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:00.785995 20017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:00.789170 19642 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 18:00:00.770624 19391 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 1 to 2, leader changed from 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65) to 35ff99af114a416382c1389003b046ef (127.17.37.66). New cstate: current_term: 2 leader_uuid: "35ff99af114a416382c1389003b046ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:00.794625 19842 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 18:00:00.795267 20020 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 18:00:00.796655 19988 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260812 18:00:00.830071 20017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:00.842221 19326 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Rejecting Update request from peer a653ad9dc1a84e9c9f052e31970f1ea0 for earlier term 1. Current term is 2. Ops: [1.13-1.13]
I20260812 18:00:00.846410 20007 consensus_queue.cc:1046] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: INVALID_TERM, Last received: 1.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260812 18:00:00.847546 20007 raft_consensus.cc:3032] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 18:00:00.847900 20007 raft_consensus.cc:729] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
I20260812 18:00:00.848766 20007 consensus_queue.cc:260] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:00.851207 20007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:00.866251 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
I20260812 18:00:00.868391 19737 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2"
dest_uuid: "35ff99af114a416382c1389003b046ef"
from {username='slave'} at 127.0.0.1:46182
I20260812 18:00:00.869115 19407 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2990073d5e564f0383a43b2f0dea89de for term 2 because replica has last-logged OpId of term: 1 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 12.
I20260812 18:00:00.868961 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23"
I20260812 18:00:00.869059 19737 raft_consensus.cc:580] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 LEADER]: Received request to step down
I20260812 18:00:00.869647 19737 raft_consensus.cc:3032] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 LEADER]: Stepping down as leader of term 2
I20260812 18:00:00.869966 19737 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:00.870715 19737 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:00.871153 19299 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de; no voters: 6de0955b56fd46699c03a928f7c2bb23, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:00.872109 19737 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 2 FOLLOWER]: Advancing to term 3
I20260812 18:00:00.872443 20017 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 2 election: Requested vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:00.873006 20017 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 18:00:01.018096 20007 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:01.018662 20007 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:01.022218 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:01.022569 20018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:01.022960 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 2.
I20260812 18:00:01.023330 20018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:01.022235 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:01.024598 19484 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 1.
I20260812 18:00:01.025787 20018 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:01.026270 19374 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23, a653ad9dc1a84e9c9f052e31970f1ea0; no voters:
I20260812 18:00:01.029382 20004 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.030160 19544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 18:00:01.029953 20004 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.030551 19544 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:01.030922 19544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 2 FOLLOWER]: Advancing to term 3
I20260812 18:00:01.032413 20004 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:01.033280 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:01.034771 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:01.035473 19737 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 3.
I20260812 18:00:01.037139 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:01.039045 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:01.028287 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:01.039817 19642 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 2.
I20260812 18:00:01.040485 19326 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6de0955b56fd46699c03a928f7c2bb23 in current term 2: Already voted for candidate 2990073d5e564f0383a43b2f0dea89de in this term.
I20260812 18:00:01.040730 19914 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.041226 19914 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.043464 19914 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:01.045938 20007 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:01.046067 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:01.045491 19544 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:01.046765 19737 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 3.
I20260812 18:00:01.048102 19407 raft_consensus.cc:2354] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6de0955b56fd46699c03a928f7c2bb23 for earlier term 2. Current term is 3.
I20260812 18:00:01.048929 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:01.049606 19842 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 2.
I20260812 18:00:01.052258 19598 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:01.053305 19914 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 18:00:01.060207 19459 leader_election.cc:398] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6de0955b56fd46699c03a928f7c2bb23 for earlier term 2. Current term is 3.
I20260812 18:00:01.073187 19459 leader_election.cc:401] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 18:00:01.076972 20018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 1 FOLLOWER]: Advancing to term 3
I20260812 18:00:01.096100 20018 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6de0955b56fd46699c03a928f7c2bb23 for earlier term 2. Current term is 3.
I20260812 18:00:01.063651 19569 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 18:00:01.065670 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de"
I20260812 18:00:01.067530 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23"
I20260812 18:00:01.069025 19544 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 3 election: Requested vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:01.071287 20004 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 18:00:01.072772 19914 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.103399 19914 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 2 FOLLOWER]: Advancing to term 3
I20260812 18:00:01.102502 20004 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.102568 19326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 2 FOLLOWER]: Advancing to term 3
I20260812 18:00:01.104938 20004 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 18:00:01.119742 20004 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.121510 19484 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 3.
I20260812 18:00:01.127883 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:01.128892 19914 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.129688 20004 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 3 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:01.129968 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:01.135247 19737 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 3.
I20260812 18:00:01.136251 19642 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fdc12507efa14578bf950e82f27ce9d1 in current term 3: Already voted for candidate 7006590bc9d14fed9b0239a1513d0a41 in this term.
I20260812 18:00:01.136276 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:01.137323 20004 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 18:00:01.141741 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:01.142541 19737 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 3: Already voted for candidate fdc12507efa14578bf950e82f27ce9d1 in this term.
I20260812 18:00:01.143945 19914 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:01.144408 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 3.
I20260812 18:00:01.145090 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:01.145592 19377 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0; no voters:
I20260812 18:00:01.147003 19544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 18:00:01.147658 19544 raft_consensus.cc:686] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 LEADER]: Becoming Leader. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
I20260812 18:00:01.148717 19544 consensus_queue.cc:237] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:01.158828 20007 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.159967 20007 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:01.170929 20026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:01.170879 20004 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:01.172118 20004 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.180850 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:01.182171 19914 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 18:00:01.183116 20026 catalog_manager.cc:669] Loaded metadata for table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]
I20260812 18:00:01.198539 20026 tablet_loader.cc:96] loaded metadata for tablet 643c7507a97e4279b5eda86d161734a2 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:01.200281 20026 tablet_loader.cc:96] loaded metadata for tablet 77412e40b9514520873b174d5415031f (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:01.201560 20026 tablet_loader.cc:96] loaded metadata for tablet ec9e64e7058844429592e9e754c776e7 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:01.203259 20026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:01.208244 20026 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 18:00:01.208606 20026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:01.214816 20026 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:01.219529 20026 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Loaded TSK: 0
I20260812 18:00:01.221002 20026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:01.236789 19326 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Refusing update from remote peer a653ad9dc1a84e9c9f052e31970f1ea0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 18:00:01.238300 20007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 18:00:01.252512 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.253285 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:01.258302 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.259079 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:01.259300 19642 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 18:00:01.260491 19484 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Refusing update from remote peer a653ad9dc1a84e9c9f052e31970f1ea0: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 18:00:01.261030 20004 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:01.262197 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.262897 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:01.264267 19544 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 18:00:01.272043 19677 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 18:00:01.279394 20018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.280146 20018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:01.280339 19737 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7"
dest_uuid: "35ff99af114a416382c1389003b046ef"
from {username='slave'} at 127.0.0.1:46182
I20260812 18:00:01.280836 19737 raft_consensus.cc:580] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 LEADER]: Received request to step down
I20260812 18:00:01.281152 19737 raft_consensus.cc:3032] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 LEADER]: Stepping down as leader of term 4
I20260812 18:00:01.281396 19737 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:01.282167 19737 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.283475 19737 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:01.286352 19388 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 2 to 3, leader changed from 35ff99af114a416382c1389003b046ef (127.17.37.66) to fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67). New cstate: current_term: 3 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } }
I20260812 18:00:01.278254 20029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.290032 20029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:01.296554 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:01.297299 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:01.313089 19737 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 18:00:01.325423 20004 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:01.331511 19775 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 18:00:01.400947 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.401450 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.403306 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:01.404258 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:01.404910 19734 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 5.
I20260812 18:00:01.404840 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:01.406826 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:01.413319 19914 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 18:00:01.413795 19914 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.414240 19914 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:01.436257 19876 heartbeater.cc:503] Master 127.17.37.125:34381 was elected leader, sending a full tablet report...
I20260812 18:00:01.445026 19914 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.447981 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:01.450620 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:01.451475 19914 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:01.448037 20025 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:01.452821 20025 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.453816 19842 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:01.456651 19734 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 5.
I20260812 18:00:01.459334 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:01.461027 19842 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 5.
I20260812 18:00:01.462747 19914 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 18:00:01.463486 20025 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
W20260812 18:00:01.467912 19798 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.37.65:37193, user_credentials={real_user=slave}} blocked reactor thread for 57889.6us
I20260812 18:00:01.480852 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:01.481492 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:01.482360 19734 raft_consensus.cc:2379] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdc12507efa14578bf950e82f27ce9d1 in current term 5: Already voted for candidate 7006590bc9d14fed9b0239a1513d0a41 in this term.
I20260812 18:00:01.485714 19914 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Becoming Leader. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:01.490551 19914 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:01.516750 19388 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 4 to 5, leader changed from 35ff99af114a416382c1389003b046ef (127.17.37.66) to 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65). New cstate: current_term: 5 leader_uuid: "7006590bc9d14fed9b0239a1513d0a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:01.519344 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:01.520323 20032 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 18:00:01.603675 19734 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 18:00:01.605096 19914 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 18:00:01.639639 19842 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 18:00:01.647658 20034 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 18:00:02.233503 19905 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:02.234544 19905 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:02.243386 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:02.244905 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:02.251127 19905 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:02.255450 19692 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:02.258111 19988 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 18:00:03.323943 19988 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:03.325587 20034 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:03.329273 20034 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:03.327926 19988 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
W20260812 18:00:03.406818 19692 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.37.67:43837, user_credentials={real_user=slave}} blocked reactor thread for 66086.7us
W20260812 18:00:03.419358 19695 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.37.65:37193, user_credentials={real_user=slave}} blocked reactor thread for 149596us
I20260812 18:00:03.427405 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:03.436460 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:03.414991 19988 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:03.444319 20034 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:03.471769 19914 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:03.481546 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:03.527746 20043 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:03.529120 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:03.529062 20043 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:03.533548 20048 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:03.534466 19598 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:03.534540 20049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:03.538764 20049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:03.503909 19914 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:03.548995 20034 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:03.535852 20048 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:03.551816 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:03.552489 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:03.556936 19914 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:03.558625 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:03.559980 20051 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 18:00:03.560191 20043 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:03.559669 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:03.564298 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:03.565877 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:03.568812 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:03.565297 20049 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:03.567286 20048 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:03.574759 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:03.572183 19296 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de; no voters: 6de0955b56fd46699c03a928f7c2bb23, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:03.578284 20049 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:03.580247 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23; no voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:03.583087 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:03.583420 20048 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:03.585496 20051 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:03.592859 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:03.594982 19598 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:03.596917 20053 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:12.026024 20069 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:12.028237 20069 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.030617 20070 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:12.030833 20069 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.031160 20070 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:12.034099 20070 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:12.052448 20032 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:12.053126 20032 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.055096 20032 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:12.056473 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:12.058171 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:12.058574 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:12.059121 19742 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 5.
I20260812 18:00:12.060966 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters: 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:12.061685 19640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:12.062317 19640 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 3.
I20260812 18:00:12.062563 20032 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 18:00:12.062883 20032 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:12.063254 20032 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:12.065384 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:12.068028 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:12.069386 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:12.069839 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:12.070165 20043 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:12.070463 20070 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:12.070792 20043 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.073536 20069 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 18:00:12.074050 20069 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:12.074457 20069 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:12.074719 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:12.077558 20043 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.083151 20032 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.083950 19843 raft_consensus.cc:1226] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Rejecting Update request from peer 7006590bc9d14fed9b0239a1513d0a41 for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:12.084513 20032 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:12.085796 20069 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.087627 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:12.087734 20069 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.087788 20061 consensus_queue.cc:1046] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 18:00:12.088900 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:12.089948 20073 raft_consensus.cc:3032] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 18:00:12.090374 20073 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:12.091733 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:12.091475 20073 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.092314 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:12.092731 20073 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:12.091028 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:12.094396 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:12.095144 20069 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 18:00:12.095504 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:12.096158 20069 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 18:00:12.102519 19641 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 6.
I20260812 18:00:12.104251 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 18:00:12.104801 20032 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 18:00:12.105170 20032 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:12.106386 20032 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.116671 19388 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 reported cstate change: term changed from 5 to 6, leader changed from 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65) to fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67). New cstate: current_term: 6 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:12.118970 19742 raft_consensus.cc:1226] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Rejecting Update request from peer fdc12507efa14578bf950e82f27ce9d1 for earlier term 3. Current term is 4. Ops: []
I20260812 18:00:12.120389 20032 consensus_queue.cc:1046] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 18:00:12.121258 20070 raft_consensus.cc:3032] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 18:00:12.121568 20070 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:12.122305 20070 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.123206 20070 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:12.214633 19742 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:12.220288 19742 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 18:00:12.221530 20070 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 18:00:12.229550 19641 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 18:00:12.231467 20032 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 18:00:12.279173 20073 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:12.279601 20073 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.280947 20073 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.281544 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:12.281656 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:12.282274 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 4.
I20260812 18:00:12.282279 19742 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 4: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 18:00:12.283128 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:12.283722 20073 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 18:00:12.283968 20073 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:12.284183 20073 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:12.288506 20073 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.289913 20073 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.290433 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:12.290619 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:12.290987 19742 raft_consensus.cc:2379] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7006590bc9d14fed9b0239a1513d0a41 in current term 4: Already voted for candidate 35ff99af114a416382c1389003b046ef in this term.
I20260812 18:00:12.295296 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 4.
I20260812 18:00:12.295989 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 18:00:12.296532 20073 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 18:00:12.296941 20073 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 LEADER]: Becoming Leader. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:12.298341 20073 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.300448 20069 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:12.300928 20069 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.302673 20069 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.303560 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:12.303689 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:12.304340 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 4.
I20260812 18:00:12.306579 19692 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters: 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:12.307307 20069 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 18:00:12.307644 20069 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:12.307958 20069 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:12.309201 19393 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 3 to 4, leader changed from fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67) to 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65). New cstate: current_term: 4 leader_uuid: "7006590bc9d14fed9b0239a1513d0a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:12.313287 20069 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.315455 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:12.315565 20069 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 5 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:12.316367 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:12.316906 19843 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:12.323750 19843 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 5.
I20260812 18:00:12.324640 19692 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters: 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:12.326112 20069 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader election won for term 5
I20260812 18:00:12.326502 20069 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 LEADER]: Becoming Leader. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:12.327507 20069 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.335336 19393 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 4 to 5, leader changed from 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65) to 35ff99af114a416382c1389003b046ef (127.17.37.66). New cstate: current_term: 5 leader_uuid: "35ff99af114a416382c1389003b046ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:12.396476 19843 raft_consensus.cc:1226] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Rejecting Update request from peer 7006590bc9d14fed9b0239a1513d0a41 for earlier term 4. Current term is 5. Ops: []
I20260812 18:00:12.397430 20073 consensus_queue.cc:1046] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 18:00:12.398157 20061 raft_consensus.cc:3032] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 18:00:12.398476 20061 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:12.399070 20061 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:12.399894 20061 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:12.436206 19843 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260812 18:00:12.437417 20069 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 18:00:12.448750 19641 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260812 18:00:12.449126 19641 pending_rounds.cc:76] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Aborting all ops after (but not including) 4
I20260812 18:00:12.449355 19641 pending_rounds.cc:97] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260812 18:00:12.449734 19641 raft_consensus.cc:2866] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 18:00:12.451593 20069 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260812 18:00:12.918370 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080009d700 after lost signal to thread 17562
W20260812 18:00:12.919482 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080009d140 after lost signal to thread 19356
W20260812 18:00:12.920225 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080004c4e0 after lost signal to thread 19438
W20260812 18:00:12.921064 19434 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7ce0 after lost signal to thread 19514
W20260812 18:00:12.922485 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800116da0 after lost signal to thread 19674
W20260812 18:00:12.923524 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080010e3a0 after lost signal to thread 19773
W20260812 18:00:12.924587 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800173a80 after lost signal to thread 19872
I20260812 18:00:15.857542 20102 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:15.858556 20102 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:15.861896 20102 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:16.050438 20103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:16.051254 20103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:16.054647 20103 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:16.075011 20104 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:16.127871 20104 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:16.131855 20104 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:16.314483 20104 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:16.315106 20104 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
W20260812 18:00:16.316416 19296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.37.124:44431 timed out after 0.261s (SENT) [suppressed 7 similar messages]
I20260812 18:00:16.317174 20104 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
W20260812 18:00:16.389490 19296 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.37.124:44431, user_credentials={real_user=slave}} blocked reactor thread for 73208.8us
W20260812 18:00:16.409026 19693 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.603s user 0.011s sys 0.001s
W20260812 18:00:16.410337 19693 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.604s user 0.011s sys 0.002s
I20260812 18:00:16.422326 19486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:16.422945 19486 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2990073d5e564f0383a43b2f0dea89de in term 3.
I20260812 18:00:16.438107 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:16.438697 19484 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2990073d5e564f0383a43b2f0dea89de in term 3.
I20260812 18:00:16.439723 19296 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23; no voters:
I20260812 18:00:16.440654 20103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 18:00:16.441043 20103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Starting leader election (detected failure of leader a653ad9dc1a84e9c9f052e31970f1ea0)
I20260812 18:00:16.441388 20103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:16.443542 20104 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:16.444135 20104 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:16.445883 20104 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:16.449442 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:16.450503 20103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:16.451012 20107 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
W20260812 18:00:16.451691 19299 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s user 0.006s sys 0.003s
W20260812 18:00:16.452090 19299 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.566s user 0.007s sys 0.003s
I20260812 18:00:16.451889 20107 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:16.452359 19326 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6de0955b56fd46699c03a928f7c2bb23 in current term 4: Already voted for candidate 2990073d5e564f0383a43b2f0dea89de in this term.
I20260812 18:00:16.453179 20103 leader_election.cc:288] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 election: Requested vote from peers a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:16.454741 20107 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:16.462198 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.465776 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:16.467932 19642 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 5.
I20260812 18:00:16.469403 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.470450 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.470932 19735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.471798 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23"
I20260812 18:00:16.472491 19484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:16.477875 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 18:00:16.478835 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.482527 20107 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:16.483085 20107 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:16.485114 20107 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:16.485633 20107 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 18:00:16.491317 20107 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:16.492591 20107 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:16.492928 19326 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 FOLLOWER]: Rejecting Update request from peer a653ad9dc1a84e9c9f052e31970f1ea0 for earlier term 3. Current term is 4. Ops: []
I20260812 18:00:16.493667 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:16.493726 19405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:16.495536 19406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2990073d5e564f0383a43b2f0dea89de" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
I20260812 18:00:16.496799 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23; no voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:16.492928 19842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:16.496872 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:16.499460 20109 consensus_queue.cc:1046] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: INVALID_TERM, Last received: 3.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260812 18:00:16.500100 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:16.500725 20112 raft_consensus.cc:3032] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 18:00:16.501187 20112 raft_consensus.cc:729] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
I20260812 18:00:16.502434 19484 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2990073d5e564f0383a43b2f0dea89de in term 4.
I20260812 18:00:16.503970 19486 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Rejecting Update request from peer a653ad9dc1a84e9c9f052e31970f1ea0 for earlier term 3. Current term is 4. Ops: []
I20260812 18:00:16.502306 20112 consensus_queue.cc:260] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:16.506239 20112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:16.506163 19592 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:16.507153 20104 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 18:00:16.507566 19592 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:16.508285 20104 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:16.508731 19592 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:16.509434 20104 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 18:00:16.509950 19296 leader_election.cc:302] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23; no voters: a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:16.510833 20103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 FOLLOWER]: Leader election won for term 4
I20260812 18:00:16.512280 20115 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:16.514976 20103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 LEADER]: Becoming Leader. State: Replica: 2990073d5e564f0383a43b2f0dea89de, State: Running, Role: LEADER
I20260812 18:00:16.516721 20103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:16.517530 20107 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:16.518689 19843 raft_consensus.cc:1226] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Rejecting Update request from peer 35ff99af114a416382c1389003b046ef for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:16.522500 20107 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:16.522360 20099 consensus_queue.cc:1046] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 18:00:16.523785 20099 raft_consensus.cc:3032] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 LEADER]: Stepping down as leader of term 5
I20260812 18:00:16.524207 20099 raft_consensus.cc:729] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
W20260812 18:00:16.525315 19798 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.37.65:37193, user_credentials={real_user=slave}} blocked reactor thread for 47541.8us
I20260812 18:00:16.528767 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:16.532927 19641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:16.533517 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:16.525185 20099 consensus_queue.cc:260] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:16.537289 20099 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:16.539561 20116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2990073d5e564f0383a43b2f0dea89de. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.540488 20116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:16.542647 20119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:16.543188 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:16.546154 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:16.547669 20114 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:16.553678 20119 catalog_manager.cc:669] Loaded metadata for table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]
I20260812 18:00:16.554749 19742 raft_consensus.cc:2454] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 6.
I20260812 18:00:16.556924 19798 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters: 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:16.557631 20107 raft_consensus.cc:2781] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 18:00:16.558144 20107 raft_consensus.cc:686] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:16.558940 20107 consensus_queue.cc:237] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:16.562745 20119 tablet_loader.cc:96] loaded metadata for tablet 643c7507a97e4279b5eda86d161734a2 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:16.570024 20119 tablet_loader.cc:96] loaded metadata for tablet 77412e40b9514520873b174d5415031f (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:16.571481 20119 tablet_loader.cc:96] loaded metadata for tablet ec9e64e7058844429592e9e754c776e7 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:16.572937 20119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:16.578430 20119 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 18:00:16.578809 20119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:16.585490 20119 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:16.590976 20119 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: Loaded TSK: 0
I20260812 18:00:16.592568 20119 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:16.621789 19484 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Refusing update from remote peer 2990073d5e564f0383a43b2f0dea89de: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 20. (index mismatch)
I20260812 18:00:16.623422 20116 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 18:00:16.628401 20115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2990073d5e564f0383a43b2f0dea89de. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.629209 20115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:16.632562 20103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.633407 20103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:16.636114 19406 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Refusing update from remote peer 2990073d5e564f0383a43b2f0dea89de: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 4 index: 20. (index mismatch)
I20260812 18:00:16.637310 20115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.637801 20116 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 18:00:16.638157 20115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:16.648121 20109 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.648401 20112 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2990073d5e564f0383a43b2f0dea89de. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.649050 20109 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:16.649274 20112 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:16.650437 19742 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 18:00:16.651968 20107 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 18:00:16.664377 19315 catalog_manager.cc:5495] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 5 to 6, leader changed from 35ff99af114a416382c1389003b046ef (127.17.37.66) to fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67). New cstate: current_term: 6 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } }
I20260812 18:00:16.669512 19643 raft_consensus.cc:3037] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:16.674417 20116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "2990073d5e564f0383a43b2f0dea89de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:16.675329 20116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:16.694785 19777 heartbeater.cc:503] Master 127.17.37.126:41863 was elected leader, sending a full tablet report...
I20260812 18:00:16.706569 19643 raft_consensus.cc:1261] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260812 18:00:16.708215 20114 consensus_queue.cc:1035] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 18:00:16.710808 19878 heartbeater.cc:503] Master 127.17.37.126:41863 was elected leader, sending a full tablet report...
I20260812 18:00:16.713092 19678 heartbeater.cc:503] Master 127.17.37.126:41863 was elected leader, sending a full tablet report...
W20260812 18:00:16.834842 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800173e60 after lost signal to thread 17562
W20260812 18:00:16.835743 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080010e080 after lost signal to thread 19356
W20260812 18:00:16.836620 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800109a60 after lost signal to thread 19438
W20260812 18:00:16.837499 19434 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3860 after lost signal to thread 19514
W20260812 18:00:16.838876 19434 debug-util.cc:398] Leaking SignalData structure 0x7b080010b260 after lost signal to thread 19674
W20260812 18:00:16.839766 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800198500 after lost signal to thread 19773
W20260812 18:00:16.840557 19434 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ba0 after lost signal to thread 19872
I20260812 18:00:23.674973 20154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:23.676072 20154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:23.678704 20154 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:23.713618 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:23.755434 20155 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:23.756120 20155 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:23.758427 20155 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.761397 20156 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:23.761935 20155 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:23.762306 20156 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:23.762554 20155 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.764593 20155 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.765024 19406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:23.765435 20156 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:23.765983 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:23.766674 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23; no voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:23.766877 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:23.767652 20154 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 18:00:23.768657 19374 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a653ad9dc1a84e9c9f052e31970f1ea0; no voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23
I20260812 18:00:23.769843 20156 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 18:00:23.772843 20158 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:23.773366 20158 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.777552 20158 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.788038 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:23.788672 19737 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 6.
I20260812 18:00:23.790349 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:23.790529 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:23.790967 19642 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 6.
I20260812 18:00:23.791790 20099 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:23.792142 20099 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.794067 20099 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.790987 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:23.796706 20149 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:23.799894 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:23.799935 20149 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:23.801615 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:23.802448 20149 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:23.802569 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:23.803196 19841 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 3.
I20260812 18:00:23.803761 20155 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 18:00:23.804205 20155 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:23.804450 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:23.804739 20155 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Advancing to term 7
I20260812 18:00:23.809654 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters: fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:23.810428 20099 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 18:00:23.810668 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:23.810796 20099 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:23.810631 19592 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef
I20260812 18:00:23.811314 20099 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Advancing to term 7
I20260812 18:00:23.812700 20161 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 18:00:23.813066 20161 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:23.813385 20161 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:23.813331 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:23.813828 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:23.816713 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:23.818332 20152 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 18:00:23.818389 20099 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.820622 20161 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:23.821020 20099 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.821259 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:23.822650 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:23.822757 20161 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.822698 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:23.823589 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:23.823911 20155 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.825608 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:23.825739 20155 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:23.825688 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:23.826184 20099 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 18:00:23.826793 20099 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 18:00:23.827390 19598 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:23.827589 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:23.827689 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:23.828353 20155 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 18:00:23.828946 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:23.829486 20155 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 18:00:23.857234 19643 raft_consensus.cc:1226] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Rejecting Update request from peer 35ff99af114a416382c1389003b046ef for earlier term 3. Current term is 4. Ops: []
I20260812 18:00:23.858317 20099 consensus_queue.cc:1046] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:23.859123 20159 raft_consensus.cc:3032] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 LEADER]: Stepping down as leader of term 3
I20260812 18:00:23.859419 20159 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:23.860040 20159 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:23.861121 20159 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 3 FOLLOWER]: Advancing to term 4
I20260812 18:00:23.883847 19742 raft_consensus.cc:1226] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 7 FOLLOWER]: Rejecting Update request from peer fdc12507efa14578bf950e82f27ce9d1 for earlier term 6. Current term is 7. Ops: []
I20260812 18:00:23.884913 20149 consensus_queue.cc:1046] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 18:00:23.885615 20152 raft_consensus.cc:3032] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 18:00:23.885936 20152 raft_consensus.cc:729] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:23.886565 20152 consensus_queue.cc:260] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:23.887713 20152 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Advancing to term 7
I20260812 18:00:24.072423 20155 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:24.073244 20155 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:24.075296 20155 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:24.075922 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:24.076596 19742 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 4.
I20260812 18:00:24.076529 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:24.077299 19841 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 3.
I20260812 18:00:24.077595 19598 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:24.078336 20155 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 18:00:24.078637 20155 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:24.078891 20155 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:24.083421 20155 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:24.084926 20155 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 election: Requested vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:24.085548 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:24.085767 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:24.086172 19734 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:24.086409 19841 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 3 FOLLOWER]: Advancing to term 5
I20260812 18:00:24.091048 19734 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 5.
I20260812 18:00:24.091495 19841 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7006590bc9d14fed9b0239a1513d0a41 in term 5.
I20260812 18:00:24.091960 19598 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41; no voters:
I20260812 18:00:24.092692 20155 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 18:00:24.093098 20155 raft_consensus.cc:686] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Becoming Leader. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:24.093534 20152 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:24.094096 20152 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:24.094094 20155 consensus_queue.cc:237] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:24.096468 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:24.097064 19643 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 7.
I20260812 18:00:24.096793 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:24.097998 19734 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 7.
I20260812 18:00:24.098047 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:24.095958 20152 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:24.099642 20149 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 18:00:24.100032 20149 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:24.100345 20149 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 7 FOLLOWER]: Advancing to term 8
I20260812 18:00:24.106312 19315 catalog_manager.cc:5495] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 reported cstate change: term changed from 3 to 5, leader changed from 35ff99af114a416382c1389003b046ef (127.17.37.66) to 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65). New cstate: current_term: 5 leader_uuid: "7006590bc9d14fed9b0239a1513d0a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:24.109236 20149 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:24.111799 20149 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 8 election: Requested vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), 35ff99af114a416382c1389003b046ef (127.17.37.66:39971)
I20260812 18:00:24.112303 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:24.112861 19643 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 7 FOLLOWER]: Advancing to term 8
I20260812 18:00:24.114116 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef"
I20260812 18:00:24.114559 19734 raft_consensus.cc:3037] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 7 FOLLOWER]: Advancing to term 8
I20260812 18:00:24.117012 19643 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 8.
I20260812 18:00:24.117934 19798 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:24.118575 20149 raft_consensus.cc:2781] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 18:00:24.119596 19734 raft_consensus.cc:2454] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc12507efa14578bf950e82f27ce9d1 in term 8.
I20260812 18:00:24.118976 20149 raft_consensus.cc:686] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 8 LEADER]: Becoming Leader. State: Replica: fdc12507efa14578bf950e82f27ce9d1, State: Running, Role: LEADER
I20260812 18:00:24.121019 20149 consensus_queue.cc:237] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:24.136583 19313 catalog_manager.cc:5495] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fdc12507efa14578bf950e82f27ce9d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:24.205833 19734 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 18:00:24.207134 20155 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:24.221176 19841 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Refusing update from remote peer 7006590bc9d14fed9b0239a1513d0a41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260812 18:00:24.223318 20161 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:24.233634 19643 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 18:00:24.235417 20149 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260812 18:00:24.250399 19734 raft_consensus.cc:1261] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Refusing update from remote peer fdc12507efa14578bf950e82f27ce9d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260812 18:00:24.252600 20160 consensus_queue.cc:1035] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260812 18:00:24.649874 19352 debug-util.cc:398] Leaking SignalData structure 0x7b080004a340 after lost signal to thread 17562
W20260812 18:00:24.651253 19352 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff200 after lost signal to thread 19356
W20260812 18:00:24.652236 19352 debug-util.cc:398] Leaking SignalData structure 0x7b08000f17c0 after lost signal to thread 19438
W20260812 18:00:24.653201 19352 debug-util.cc:398] Leaking SignalData structure 0x7b08002403e0 after lost signal to thread 19514
W20260812 18:00:24.656312 19352 debug-util.cc:398] Leaking SignalData structure 0x7b0800072420 after lost signal to thread 19674
W20260812 18:00:24.657403 19352 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8f60 after lost signal to thread 19773
W20260812 18:00:24.658366 19352 debug-util.cc:398] Leaking SignalData structure 0x7b08000fddc0 after lost signal to thread 19872
I20260812 18:00:30.453298 20205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:30.453778 20198 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:30.453956 20205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.454269 20198 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:30.450492 20204 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:30.456658 20198 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:30.456488 20204 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:30.451704 20202 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:30.458448 20202 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:30.461410 20204 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:30.462240 20200 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:30.462982 20200 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:30.463831 20205 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:30.465365 20202 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:30.466361 20200 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:30.501536 20208 raft_consensus.cc:482] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:30.502434 20208 raft_consensus.cc:504] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:30.506106 20208 leader_election.cc:288] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:30.526448 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:30.527498 19841 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 5.
I20260812 18:00:30.529309 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:30.530465 19692 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:30.533030 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:30.536399 20200 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 18:00:30.536895 20200 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7006590bc9d14fed9b0239a1513d0a41)
I20260812 18:00:30.537360 20200 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:30.546810 20200 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:30.548151 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:30.548378 20200 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 election: Requested vote from peers fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
I20260812 18:00:30.549449 19844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1"
I20260812 18:00:30.550391 19844 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:30.558837 19406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:30.559695 19406 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6de0955b56fd46699c03a928f7c2bb23 in term 4.
I20260812 18:00:30.562079 19844 raft_consensus.cc:2454] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ff99af114a416382c1389003b046ef in term 6.
I20260812 18:00:30.562469 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23, a653ad9dc1a84e9c9f052e31970f1ea0; no voters: 2990073d5e564f0383a43b2f0dea89de
I20260812 18:00:30.563314 19692 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1; no voters:
I20260812 18:00:30.563802 20205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 18:00:30.564205 20205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:30.564634 20205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:30.570497 20200 raft_consensus.cc:2781] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader election won for term 6
I20260812 18:00:30.570739 19735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.572050 20208 raft_consensus.cc:482] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fdc12507efa14578bf950e82f27ce9d1)
I20260812 18:00:30.572520 20200 raft_consensus.cc:686] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 LEADER]: Becoming Leader. State: Replica: 35ff99af114a416382c1389003b046ef, State: Running, Role: LEADER
I20260812 18:00:30.572765 20208 raft_consensus.cc:504] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } } peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } }
I20260812 18:00:30.573740 20200 consensus_queue.cc:237] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:30.576093 20208 leader_election.cc:288] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), fdc12507efa14578bf950e82f27ce9d1 (127.17.37.67:43837)
I20260812 18:00:30.738701 20205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.740419 19484 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Rejecting Update request from peer 2990073d5e564f0383a43b2f0dea89de for earlier term 4. Current term is 5. Ops: []
I20260812 18:00:30.742461 20205 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 election: Requested vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:30.743503 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de"
I20260812 18:00:30.743708 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
I20260812 18:00:30.745085 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6de0955b56fd46699c03a928f7c2bb23; no voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:30.745718 20205 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260812 18:00:30.769908 19598 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.37.66:39971 timed out after 0.263s (SENT) [suppressed 1 similar messages]
I20260812 18:00:30.790633 20210 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 }, Status: INVALID_TERM, Last received: 4.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260812 18:00:30.792199 20210 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 LEADER]: Stepping down as leader of term 4
W20260812 18:00:30.792104 19735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 442) took 222 ms (client timeout 272 ms). Trace:
I20260812 18:00:30.792764 20210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2990073d5e564f0383a43b2f0dea89de, State: Running, Role: LEADER
I20260812 18:00:30.793620 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:30.793741 20210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 4.23, Last appended by leader: 23, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.796517 19843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:30.797052 20210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 4 FOLLOWER]: Advancing to term 5
W20260812 18:00:30.792943 19735 rpcz_store.cc:269] 0812 18:00:30.569459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 18:00:30.569742 (+ 283us) service_pool.cc:227] Handling call
0812 18:00:30.791767 (+222025us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000e33d4. stack: 00007f1cd362c033 00007f1cd362bf30 00007f1cd2f8a534 00000000003b4464 00000000003b43f9 00007f1cd9e50471 00007f1cd9ecf2ae 00007f1cdc0d8c27 00007f1cd9a60c04 00007f1cd9a60b92 00007f1cd9a60ac1 00007f1cd9a60a3c 00007f1cd9a5fcf2 00007f1cd818c94c 00007f1cd818bd86 00007f1cd818b72f
0812 18:00:30.791971 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":387830016}
W20260812 18:00:30.807883 19695 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.709s user 0.010s sys 0.009s
W20260812 18:00:30.808271 19695 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.710s user 0.010s sys 0.009s
I20260812 18:00:30.810468 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:30.812314 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:30.812505 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:30.814072 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "35ff99af114a416382c1389003b046ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41"
I20260812 18:00:30.819290 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.819690 19735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.820439 19742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9e64e7058844429592e9e754c776e7" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.821175 19737 raft_consensus.cc:1226] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 LEADER]: Rejecting Update request from peer 7006590bc9d14fed9b0239a1513d0a41 for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:30.821684 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fdc12507efa14578bf950e82f27ce9d1" is_pre_election: true
I20260812 18:00:30.822508 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "643c7507a97e4279b5eda86d161734a2" candidate_uuid: "7006590bc9d14fed9b0239a1513d0a41" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.824117 19844 raft_consensus.cc:1226] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Rejecting Update request from peer 7006590bc9d14fed9b0239a1513d0a41 for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:30.830937 19598 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:30.832724 20209 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 18:00:30.833501 19695 leader_election.cc:302] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:30.834499 20200 raft_consensus.cc:2726] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 18:00:30.836550 19695 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ff99af114a416382c1389003b046ef; no voters: 7006590bc9d14fed9b0239a1513d0a41, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:30.838014 19737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ff99af114a416382c1389003b046ef" is_pre_election: true
I20260812 18:00:30.838694 20200 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 18:00:30.837883 20208 consensus_queue.cc:1046] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 18:00:30.840098 20208 raft_consensus.cc:3032] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 18:00:30.840982 20209 consensus_queue.cc:1046] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 18:00:30.842468 20209 consensus_queue.cc:1225] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [LEADER]: Peer 35ff99af114a416382c1389003b046ef log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 18:00:30.841661 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77412e40b9514520873b174d5415031f" candidate_uuid: "fdc12507efa14578bf950e82f27ce9d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7006590bc9d14fed9b0239a1513d0a41" is_pre_election: true
I20260812 18:00:30.840593 20208 raft_consensus.cc:729] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7006590bc9d14fed9b0239a1513d0a41, State: Running, Role: LEADER
I20260812 18:00:30.848161 20208 consensus_queue.cc:260] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:30.851341 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:30.852443 20203 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 18:00:30.853459 19598 leader_election.cc:302] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7006590bc9d14fed9b0239a1513d0a41; no voters: 35ff99af114a416382c1389003b046ef, fdc12507efa14578bf950e82f27ce9d1
I20260812 18:00:30.854884 20221 raft_consensus.cc:2726] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 18:00:30.857033 20208 raft_consensus.cc:3037] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:30.890209 19844 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 18:00:30.893355 20202 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 18:00:30.903766 19642 raft_consensus.cc:1261] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Refusing update from remote peer 35ff99af114a416382c1389003b046ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260812 18:00:30.914738 20204 consensus_queue.cc:1035] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 18:00:30.938558 20226 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:30.939028 20226 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.941172 20226 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:30.943145 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:30.944154 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 5.
I20260812 18:00:30.945658 19377 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0; no voters:
I20260812 18:00:30.946550 20226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 18:00:30.946924 20226 raft_consensus.cc:482] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2990073d5e564f0383a43b2f0dea89de)
I20260812 18:00:30.947273 20226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 4 FOLLOWER]: Advancing to term 5
I20260812 18:00:30.943356 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23" is_pre_election: true
I20260812 18:00:30.949522 19484 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a653ad9dc1a84e9c9f052e31970f1ea0 in current term 5: Already voted for candidate 6de0955b56fd46699c03a928f7c2bb23 in this term.
I20260812 18:00:30.956090 20226 raft_consensus.cc:504] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.958918 20226 leader_election.cc:288] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 election: Requested vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), 6de0955b56fd46699c03a928f7c2bb23 (127.17.37.124:44431)
I20260812 18:00:30.958964 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de"
I20260812 18:00:30.962884 19484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" candidate_term: 5 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "6de0955b56fd46699c03a928f7c2bb23"
I20260812 18:00:30.963575 19484 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a653ad9dc1a84e9c9f052e31970f1ea0 in current term 5: Already voted for candidate 6de0955b56fd46699c03a928f7c2bb23 in this term.
I20260812 18:00:30.966221 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a653ad9dc1a84e9c9f052e31970f1ea0 in term 5.
I20260812 18:00:30.967036 19377 leader_election.cc:302] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, a653ad9dc1a84e9c9f052e31970f1ea0; no voters: 6de0955b56fd46699c03a928f7c2bb23
I20260812 18:00:30.967664 20226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 18:00:30.968714 20226 raft_consensus.cc:686] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 LEADER]: Becoming Leader. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
I20260812 18:00:30.969715 20226 consensus_queue.cc:237] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 4.23, Last appended by leader: 23, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:30.975704 20228 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a653ad9dc1a84e9c9f052e31970f1ea0. Latest consensus state: current_term: 5 leader_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:30.976329 20228 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:31.004590 20205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:31.005113 20205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:31.008230 20205 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:31.008888 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de" is_pre_election: true
I20260812 18:00:31.009547 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6de0955b56fd46699c03a928f7c2bb23 in term 5.
I20260812 18:00:31.009727 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" is_pre_election: true
I20260812 18:00:31.010572 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23; no voters:
I20260812 18:00:31.011376 20205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 18:00:31.011837 20205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:31.012182 20205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:31.020046 20205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:31.022050 20205 leader_election.cc:288] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 6 election: Requested vote from peers 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863), a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381)
I20260812 18:00:31.023144 19407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0"
I20260812 18:00:31.024431 19326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6de0955b56fd46699c03a928f7c2bb23" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "2990073d5e564f0383a43b2f0dea89de"
I20260812 18:00:31.024858 19326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:31.029240 19326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6de0955b56fd46699c03a928f7c2bb23 in term 6.
I20260812 18:00:31.030089 19459 leader_election.cc:302] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2990073d5e564f0383a43b2f0dea89de, 6de0955b56fd46699c03a928f7c2bb23; no voters: a653ad9dc1a84e9c9f052e31970f1ea0
I20260812 18:00:31.030903 20205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 18:00:31.032334 20205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 LEADER]: Becoming Leader. State: Replica: 6de0955b56fd46699c03a928f7c2bb23, State: Running, Role: LEADER
I20260812 18:00:31.033356 20205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 4.23, Last appended by leader: 23, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:31.041935 20231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6de0955b56fd46699c03a928f7c2bb23. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.042870 20231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:31.044708 20234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:31.052280 20234 catalog_manager.cc:669] Loaded metadata for table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]
I20260812 18:00:31.055197 19326 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 6 FOLLOWER]: Rejecting Update request from peer a653ad9dc1a84e9c9f052e31970f1ea0 for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:31.058547 20226 consensus_queue.cc:1046] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260812 18:00:31.059253 20234 tablet_loader.cc:96] loaded metadata for tablet 643c7507a97e4279b5eda86d161734a2 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:31.060865 20234 tablet_loader.cc:96] loaded metadata for tablet 77412e40b9514520873b174d5415031f (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:31.062259 20234 tablet_loader.cc:96] loaded metadata for tablet ec9e64e7058844429592e9e754c776e7 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:31.062623 20235 raft_consensus.cc:3032] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 18:00:31.063051 20235 raft_consensus.cc:729] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a653ad9dc1a84e9c9f052e31970f1ea0, State: Running, Role: LEADER
I20260812 18:00:31.063623 20234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:31.064188 20235 consensus_queue.cc:260] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 5.24, Last appended by leader: 24, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } }
I20260812 18:00:31.065654 20235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 5 FOLLOWER]: Advancing to term 6
I20260812 18:00:31.066721 19484 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 LEADER]: Rejecting Update request from peer a653ad9dc1a84e9c9f052e31970f1ea0 for earlier term 5. Current term is 6. Ops: []
I20260812 18:00:31.069453 20234 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 18:00:31.069756 20234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:31.075958 20234 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:31.079303 20234 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: Loaded TSK: 0
I20260812 18:00:31.080281 20234 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:31.126726 19326 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 6 FOLLOWER]: Refusing update from remote peer 6de0955b56fd46699c03a928f7c2bb23: Log matching property violated. Preceding OpId in replica: term: 4 index: 23. Preceding OpId from leader: term: 6 index: 24. (index mismatch)
I20260812 18:00:31.128151 20231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260812 18:00:31.133370 20210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6de0955b56fd46699c03a928f7c2bb23. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.134223 20210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:31.136782 19407 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 6 FOLLOWER]: Refusing update from remote peer 6de0955b56fd46699c03a928f7c2bb23: Log matching property violated. Preceding OpId in replica: term: 5 index: 24. Preceding OpId from leader: term: 6 index: 24. (term mismatch)
I20260812 18:00:31.137615 19407 pending_rounds.cc:76] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Aborting all ops after (but not including) 23
I20260812 18:00:31.137848 19407 pending_rounds.cc:97] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Aborting uncommitted NO_OP operation due to leader change: 5.24
I20260812 18:00:31.138162 19407 raft_consensus.cc:2866] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 18:00:31.140463 20231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.007s
I20260812 18:00:31.154383 20210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.155449 20210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:31.156486 20228 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.157213 20235 sys_catalog.cc:455] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6de0955b56fd46699c03a928f7c2bb23. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.157250 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.158416 20235 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:31.157227 20228 sys_catalog.cc:458] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 18:00:31.158668 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:31.206738 19774 heartbeater.cc:503] Master 127.17.37.124:44431 was elected leader, sending a full tablet report...
I20260812 18:00:31.212097 19471 catalog_manager.cc:5495] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef reported cstate change: term changed from 5 to 6, leader changed from 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65) to 35ff99af114a416382c1389003b046ef (127.17.37.66). New cstate: current_term: 6 leader_uuid: "35ff99af114a416382c1389003b046ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:31.218338 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:31.219115 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:31.247970 19873 heartbeater.cc:503] Master 127.17.37.124:44431 was elected leader, sending a full tablet report...
I20260812 18:00:31.266171 19676 heartbeater.cc:503] Master 127.17.37.124:44431 was elected leader, sending a full tablet report...
W20260812 18:00:31.578819 19769 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7060 after lost signal to thread 17562
W20260812 18:00:31.580188 19769 debug-util.cc:398] Leaking SignalData structure 0x7b08001d77c0 after lost signal to thread 19356
W20260812 18:00:31.581224 19769 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7e80 after lost signal to thread 19438
W20260812 18:00:31.582050 19769 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7740 after lost signal to thread 19514
W20260812 18:00:31.583258 19769 debug-util.cc:398] Leaking SignalData structure 0x7b0800008640 after lost signal to thread 19674
W20260812 18:00:31.584365 19769 debug-util.cc:398] Leaking SignalData structure 0x7b0800144f40 after lost signal to thread 19773
W20260812 18:00:31.585332 19769 debug-util.cc:398] Leaking SignalData structure 0x7b080015bf40 after lost signal to thread 19872
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:783: Failure
Expected equality of these values:
live_row_count
Which is: 802
table_info->GetMetrics()->live_row_count->value()
Which is: 1604
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:767: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260812 18:00:32.324894 20230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:785: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 782, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
Actual: it does.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/ts_tablet_manager-itest.cc:857: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260812 18:00:32.333669 20230 catalog_manager.cc:669] Loaded metadata for table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d]
I20260812 18:00:32.340009 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:32.341564 20230 tablet_loader.cc:96] loaded metadata for tablet 643c7507a97e4279b5eda86d161734a2 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:32.354101 20230 tablet_loader.cc:96] loaded metadata for tablet 77412e40b9514520873b174d5415031f (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:32.357002 20230 tablet_loader.cc:96] loaded metadata for tablet ec9e64e7058844429592e9e754c776e7 (table test-table [id=f17c6aaaef0646fc84c45c9ec61ab10d])
I20260812 18:00:32.358736 20230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:32.363791 20230 catalog_manager.cc:1259] Loaded cluster ID: 692df3eddcb64737a3854062edf56247
I20260812 18:00:32.364157 20230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:32.371163 20230 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:32.376753 20230 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: Loaded TSK: 0
I20260812 18:00:32.378050 20230 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 18:00:32.408885 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260812 18:00:32.409585 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:32.414289 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:32.415307 17557 tablet_replica.cc:330] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41: stopping tablet replica
I20260812 18:00:32.416344 17557 raft_consensus.cc:2229] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:32.416925 17557 raft_consensus.cc:2258] T 77412e40b9514520873b174d5415031f P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260812 18:00:32.418744 19695 consensus_peers.cc:487] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:32.422267 17557 tablet_replica.cc:330] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41: stopping tablet replica
I20260812 18:00:32.422976 17557 raft_consensus.cc:2229] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:32.423534 17557 raft_consensus.cc:2258] T ec9e64e7058844429592e9e754c776e7 P 7006590bc9d14fed9b0239a1513d0a41 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:32.427326 17557 tablet_replica.cc:330] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41: stopping tablet replica
I20260812 18:00:32.427976 17557 raft_consensus.cc:2229] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:32.428485 17557 raft_consensus.cc:2258] T 643c7507a97e4279b5eda86d161734a2 P 7006590bc9d14fed9b0239a1513d0a41 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:32.514387 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:32.534354 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 18:00:32.582357 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:32.585637 17557 tablet_replica.cc:330] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef: stopping tablet replica
I20260812 18:00:32.586591 17557 raft_consensus.cc:2229] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:32.587297 17557 raft_consensus.cc:2258] T 643c7507a97e4279b5eda86d161734a2 P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Raft consensus is shut down!
W20260812 18:00:32.587731 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:32.590291 17557 tablet_replica.cc:330] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef: stopping tablet replica
I20260812 18:00:32.590821 17557 raft_consensus.cc:2229] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:32.591287 17557 raft_consensus.cc:2258] T ec9e64e7058844429592e9e754c776e7 P 35ff99af114a416382c1389003b046ef [term 8 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:32.593739 17557 tablet_replica.cc:330] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef: stopping tablet replica
I20260812 18:00:32.594226 17557 raft_consensus.cc:2229] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 LEADER]: Raft consensus shutting down.
I20260812 18:00:32.595053 17557 raft_consensus.cc:2258] T 77412e40b9514520873b174d5415031f P 35ff99af114a416382c1389003b046ef [term 6 FOLLOWER]: Raft consensus is shut down!
W20260812 18:00:32.596655 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:32.696061 20253 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:32.696473 20253 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:32.698019 20253 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 18:00:32.700935 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111)
W20260812 18:00:32.701601 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111)
I20260812 18:00:32.701907 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:32.702450 20253 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 18:00:32.895895 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 18:00:32.911741 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 18:00:32.946493 20253 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:32.946951 20253 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:32.948457 20253 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 18:00:32.953204 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111)
W20260812 18:00:32.953975 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111)
I20260812 18:00:32.954293 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:32.954923 20253 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 18:00:33.078622 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 18:00:33.099929 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 18:00:33.191427 20253 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:33.191968 20253 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:33.193539 20253 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 18:00:33.196568 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111)
W20260812 18:00:33.197178 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111)
I20260812 18:00:33.197556 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:33.198252 20253 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 18:00:33.368497 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 18:00:33.377532 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 18:00:33.491797 20253 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:33.492363 20253 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:33.494274 20253 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 18:00:33.497136 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111)
W20260812 18:00:33.497665 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111)
I20260812 18:00:33.498000 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:33.498528 20253 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 18:00:33.567394 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 18:00:33.618633 17557 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 19769)
W20260812 18:00:33.619558 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 18:00:33.712316 20253 raft_consensus.cc:482] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ff99af114a416382c1389003b046ef)
I20260812 18:00:33.712770 20253 raft_consensus.cc:504] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35ff99af114a416382c1389003b046ef" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39971 } } peers { permanent_uuid: "fdc12507efa14578bf950e82f27ce9d1" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 43837 } } peers { permanent_uuid: "7006590bc9d14fed9b0239a1513d0a41" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37193 } }
I20260812 18:00:33.714460 20253 leader_election.cc:288] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ff99af114a416382c1389003b046ef (127.17.37.66:39971), 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193)
W20260812 18:00:33.717343 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111)
W20260812 18:00:33.717878 19798 leader_election.cc:334] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111)
I20260812 18:00:33.718166 19798 leader_election.cc:302] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc12507efa14578bf950e82f27ce9d1; no voters: 35ff99af114a416382c1389003b046ef, 7006590bc9d14fed9b0239a1513d0a41
I20260812 18:00:33.718649 20253 raft_consensus.cc:2726] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 18:00:33.857573 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 18:00:33.875926 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 18:00:34.086274 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 18:00:34.145123 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 18:00:34.376835 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 18:00:34.397094 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 18:00:34.609210 19798 consensus_peers.cc:487] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 18:00:34.619078 17557 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 19769)
W20260812 18:00:34.640667 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 35ff99af114a416382c1389003b046ef (127.17.37.66:39971): Couldn't send request to peer 35ff99af114a416382c1389003b046ef. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.66:39971: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 18:00:34.781100 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 18:00:34.799718 17557 tablet_server.cc:178] TabletServer@127.17.37.67:0 shutting down...
I20260812 18:00:34.838397 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:34.839181 17557 tablet_replica.cc:330] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1: stopping tablet replica
I20260812 18:00:34.839859 17557 raft_consensus.cc:2229] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 LEADER]: Raft consensus shutting down.
W20260812 18:00:34.840339 19798 consensus_peers.cc:487] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 -> Peer 7006590bc9d14fed9b0239a1513d0a41 (127.17.37.65:37193): Couldn't send request to peer 7006590bc9d14fed9b0239a1513d0a41. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.65:37193: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260812 18:00:34.840884 17557 raft_consensus.cc:2258] T 643c7507a97e4279b5eda86d161734a2 P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:34.843588 17557 tablet_replica.cc:330] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1: stopping tablet replica
I20260812 18:00:34.844067 17557 raft_consensus.cc:2229] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 8 LEADER]: Raft consensus shutting down.
I20260812 18:00:34.844832 17557 raft_consensus.cc:2258] T ec9e64e7058844429592e9e754c776e7 P fdc12507efa14578bf950e82f27ce9d1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:34.847079 17557 tablet_replica.cc:330] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1: stopping tablet replica
I20260812 18:00:34.847513 17557 raft_consensus.cc:2229] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:34.847909 17557 raft_consensus.cc:2258] T 77412e40b9514520873b174d5415031f P fdc12507efa14578bf950e82f27ce9d1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:34.868824 17557 tablet_server.cc:194] TabletServer@127.17.37.67:0 shutdown complete.
I20260812 18:00:34.884433 17557 master.cc:537] Master@127.17.37.126:41863 shutting down...
I20260812 18:00:34.914806 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:34.915335 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:34.915716 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2990073d5e564f0383a43b2f0dea89de: stopping tablet replica
I20260812 18:00:34.950112 17557 master.cc:552] Master@127.17.37.126:41863 shutdown complete.
W20260812 18:00:34.965847 19459 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 -> Peer 2990073d5e564f0383a43b2f0dea89de (127.17.37.126:41863): Couldn't send request to peer 2990073d5e564f0383a43b2f0dea89de. Status: Network error: Client connection negotiation failed: client connection to 127.17.37.126:41863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:34.970989 17557 master.cc:537] Master@127.17.37.125:34381 shutting down...
I20260812 18:00:34.994583 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:34.995159 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:34.995427 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P a653ad9dc1a84e9c9f052e31970f1ea0: stopping tablet replica
W20260812 18:00:34.999137 19459 connection.cc:535] client connection to 127.17.37.125:34381 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 18:00:34.999670 19459 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 -> Peer a653ad9dc1a84e9c9f052e31970f1ea0 (127.17.37.125:34381): Couldn't send request to peer a653ad9dc1a84e9c9f052e31970f1ea0. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:35.037284 17557 master.cc:552] Master@127.17.37.125:34381 shutdown complete.
I20260812 18:00:35.043927 20248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "6de0955b56fd46699c03a928f7c2bb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2990073d5e564f0383a43b2f0dea89de" member_type: VOTER last_known_addr { host: "127.17.37.126" port: 41863 } } peers { permanent_uuid: "a653ad9dc1a84e9c9f052e31970f1ea0" member_type: VOTER last_known_addr { host: "127.17.37.125" port: 34381 } } peers { permanent_uuid: "6de0955b56fd46699c03a928f7c2bb23" member_type: VOTER last_known_addr { host: "127.17.37.124" port: 44431 } } }
I20260812 18:00:35.044979 20248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:35.057768 17557 master.cc:537] Master@127.17.37.124:44431 shutting down...
I20260812 18:00:35.080658 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 LEADER]: Raft consensus shutting down.
I20260812 18:00:35.081449 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:35.081887 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6de0955b56fd46699c03a928f7c2bb23: stopping tablet replica
I20260812 18:00:35.114153 17557 master.cc:552] Master@127.17.37.124:44431 shutdown complete.
I20260812 18:00:35.140117 17557 test_util.cc:175] -----------------------------------------------
I20260812 18:00:35.140311 17557 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786557580379316-17557-0
[ FAILED ] TsTabletManagerITest.TestTableStats (38397 ms)
[ RUN ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260812 18:00:35.146561 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:40499
I20260812 18:00:35.147603 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:35.153712 20272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.153748 20271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.155637 20274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:35.156438 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:35.158663 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:35.158881 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:35.159031 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557635159018 us; error 0 us; skew 500 ppm
I20260812 18:00:35.159514 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:35.161892 17557 webserver.cc:460] Webserver started at http://127.17.37.126:38897/ using document root <none> and password file <none>
I20260812 18:00:35.162370 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:35.162563 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:35.162871 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:35.164064 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "aabf4bcccbdc417ebe5628822d4c5fcc"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.168154 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 18:00:35.171202 20279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.172104 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 18:00:35.172343 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "aabf4bcccbdc417ebe5628822d4c5fcc"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.172581 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:35.185881 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:35.186949 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:35.224459 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:40499
I20260812 18:00:35.224557 20342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:40499 every 8 connection(s)
I20260812 18:00:35.228381 20345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:35.238751 20345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: Bootstrap starting.
I20260812 18:00:35.243480 20345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:35.247666 20345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: No bootstrap required, opened a new log
I20260812 18:00:35.249572 20345 raft_consensus.cc:348] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER }
I20260812 18:00:35.250059 20345 raft_consensus.cc:374] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:35.250298 20345 raft_consensus.cc:729] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aabf4bcccbdc417ebe5628822d4c5fcc, State: Initialized, Role: FOLLOWER
I20260812 18:00:35.250963 20345 consensus_queue.cc:260] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER }
I20260812 18:00:35.251423 20345 raft_consensus.cc:388] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:35.251694 20345 raft_consensus.cc:482] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:35.252020 20345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:35.256292 20345 raft_consensus.cc:504] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER }
I20260812 18:00:35.256790 20345 leader_election.cc:302] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aabf4bcccbdc417ebe5628822d4c5fcc; no voters:
I20260812 18:00:35.258011 20345 leader_election.cc:288] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:35.258303 20348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:35.259649 20348 raft_consensus.cc:686] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 1 LEADER]: Becoming Leader. State: Replica: aabf4bcccbdc417ebe5628822d4c5fcc, State: Running, Role: LEADER
I20260812 18:00:35.260277 20348 consensus_queue.cc:237] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER }
I20260812 18:00:35.260947 20345 sys_catalog.cc:564] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:35.263425 20352 sys_catalog.cc:455] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader aabf4bcccbdc417ebe5628822d4c5fcc. Latest consensus state: current_term: 1 leader_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER } }
I20260812 18:00:35.263429 20351 sys_catalog.cc:455] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aabf4bcccbdc417ebe5628822d4c5fcc" member_type: VOTER } }
I20260812 18:00:35.264222 20352 sys_catalog.cc:458] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:35.264407 20351 sys_catalog.cc:458] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:35.267027 20356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:35.274833 20356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:35.275892 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:35.283113 20356 catalog_manager.cc:1347] Generated new cluster ID: 94e3e1a88b3d4ba3856445782381b406
I20260812 18:00:35.283375 20356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:35.306008 20356 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:35.307551 20356 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:35.325106 20356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: Generated new TSK 0
I20260812 18:00:35.325699 20356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:35.342115 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:35.348670 20369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.349977 20371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.351877 20373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:35.352370 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:35.353634 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:35.353803 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:35.354027 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557635353996 us; error 0 us; skew 500 ppm
I20260812 18:00:35.354549 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:35.356823 17557 webserver.cc:460] Webserver started at http://127.17.37.65:35749/ using document root <none> and password file <none>
I20260812 18:00:35.357303 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:35.357511 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:35.357751 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:35.358768 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "11bff86d4e854e4ab7cf0d55869d630e"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.363217 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 18:00:35.366135 20378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.366822 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260812 18:00:35.367107 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "11bff86d4e854e4ab7cf0d55869d630e"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.367368 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:35.399962 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:35.401036 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:35.402513 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:35.404664 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:35.404861 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.405123 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:35.405283 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.445125 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:42109
I20260812 18:00:35.445230 20450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:42109 every 8 connection(s)
I20260812 18:00:35.449744 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:35.457309 20457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.458968 20459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.460438 20461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:35.461009 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:35.462309 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:35.462544 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:35.462725 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557635462711 us; error 0 us; skew 500 ppm
I20260812 18:00:35.463258 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:35.464602 20453 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40499
I20260812 18:00:35.464893 20453 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:35.465451 20453 heartbeater.cc:511] Master 127.17.37.126:40499 requested a full tablet report, sending...
I20260812 18:00:35.466150 17557 webserver.cc:460] Webserver started at http://127.17.37.66:40719/ using document root <none> and password file <none>
I20260812 18:00:35.466636 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:35.466830 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:35.467098 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:35.467484 20303 ts_manager.cc:194] Registered new tserver with Master: 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109)
I20260812 18:00:35.468374 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "6403a978938c4cc0b78001a8f95ddb0a"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.469758 20303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45708
I20260812 18:00:35.473457 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 18:00:35.476742 20467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.477476 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:35.477736 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "6403a978938c4cc0b78001a8f95ddb0a"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.478088 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:35.492146 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:35.493201 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:35.494634 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:35.496706 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:35.496927 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.497167 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:35.497323 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.537345 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:39545
I20260812 18:00:35.537444 20541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:39545 every 8 connection(s)
I20260812 18:00:35.542073 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:35.549312 20546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.551276 20548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:35.553223 20550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:35.553776 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:35.554780 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:35.555037 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:35.555249 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557635555232 us; error 0 us; skew 500 ppm
I20260812 18:00:35.555792 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:35.556398 20542 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40499
I20260812 18:00:35.556840 20542 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:35.557667 20542 heartbeater.cc:511] Master 127.17.37.126:40499 requested a full tablet report, sending...
I20260812 18:00:35.558595 17557 webserver.cc:460] Webserver started at http://127.17.37.67:45037/ using document root <none> and password file <none>
I20260812 18:00:35.559216 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:35.559492 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:35.559762 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:35.559924 20303 ts_manager.cc:194] Registered new tserver with Master: 6403a978938c4cc0b78001a8f95ddb0a (127.17.37.66:39545)
I20260812 18:00:35.560889 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root/instance:
uuid: "ce226085d52f4f10be71ad799d5470ee"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.561786 20303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45724
I20260812 18:00:35.566249 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 18:00:35.569864 20559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.570634 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:35.570916 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root
uuid: "ce226085d52f4f10be71ad799d5470ee"
format_stamp: "Formatted at 2026-08-12 18:00:35 on dist-test-slave-6nmv"
I20260812 18:00:35.571206 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:35.601081 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:35.602195 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:35.603657 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:35.605683 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:35.605892 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.606132 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:35.606287 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:35.645390 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.67:34653
I20260812 18:00:35.645488 20640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.67:34653 every 8 connection(s)
I20260812 18:00:35.660475 20641 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40499
I20260812 18:00:35.660845 20641 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:35.661506 20641 heartbeater.cc:511] Master 127.17.37.126:40499 requested a full tablet report, sending...
I20260812 18:00:35.663218 20303 ts_manager.cc:194] Registered new tserver with Master: ce226085d52f4f10be71ad799d5470ee (127.17.37.67:34653)
I20260812 18:00:35.663715 17557 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015356125s
I20260812 18:00:35.665033 20303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45726
I20260812 18:00:35.700681 20303 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260812 18:00:35.702529 20303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 18:00:35.746541 20503 tablet_service.cc:1467] Processing CreateTablet for tablet 39bc642ba10f4964b08a656455959767 (DEFAULT_TABLE table=test-table [id=a0c2f679631741c8a62d3e4516f0ab72]), partition=
I20260812 18:00:35.747067 20412 tablet_service.cc:1467] Processing CreateTablet for tablet 39bc642ba10f4964b08a656455959767 (DEFAULT_TABLE table=test-table [id=a0c2f679631741c8a62d3e4516f0ab72]), partition=
I20260812 18:00:35.747551 20503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bc642ba10f4964b08a656455959767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:35.748137 20412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bc642ba10f4964b08a656455959767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:35.750401 20594 tablet_service.cc:1467] Processing CreateTablet for tablet 39bc642ba10f4964b08a656455959767 (DEFAULT_TABLE table=test-table [id=a0c2f679631741c8a62d3e4516f0ab72]), partition=
I20260812 18:00:35.751518 20594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bc642ba10f4964b08a656455959767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:35.760193 20659 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Bootstrap starting.
I20260812 18:00:35.765360 20659 tablet_bootstrap.cc:654] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:35.767676 20660 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Bootstrap starting.
I20260812 18:00:35.768217 20661 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Bootstrap starting.
I20260812 18:00:35.771366 20659 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: No bootstrap required, opened a new log
I20260812 18:00:35.771870 20659 ts_tablet_manager.cc:1397] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260812 18:00:35.774534 20660 tablet_bootstrap.cc:654] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:35.774925 20661 tablet_bootstrap.cc:654] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:35.774729 20659 raft_consensus.cc:348] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.775548 20659 raft_consensus.cc:374] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:35.775856 20659 raft_consensus.cc:729] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6403a978938c4cc0b78001a8f95ddb0a, State: Initialized, Role: FOLLOWER
I20260812 18:00:35.776639 20659 consensus_queue.cc:260] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.780486 20660 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: No bootstrap required, opened a new log
I20260812 18:00:35.781070 20660 ts_tablet_manager.cc:1397] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260812 18:00:35.784446 20660 raft_consensus.cc:348] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.785303 20660 raft_consensus.cc:374] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:35.785630 20660 raft_consensus.cc:729] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce226085d52f4f10be71ad799d5470ee, State: Initialized, Role: FOLLOWER
I20260812 18:00:35.786669 20660 consensus_queue.cc:260] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.788278 20542 heartbeater.cc:503] Master 127.17.37.126:40499 was elected leader, sending a full tablet report...
I20260812 18:00:35.788623 20659 ts_tablet_manager.cc:1428] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Time spent starting tablet: real 0.016s user 0.007s sys 0.011s
W20260812 18:00:35.788870 20659 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260812 18:00:35.790943 20641 heartbeater.cc:503] Master 127.17.37.126:40499 was elected leader, sending a full tablet report...
W20260812 18:00:35.791116 20543 tablet.cc:2369] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 18:00:35.791391 20660 ts_tablet_manager.cc:1428] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
W20260812 18:00:35.791714 20660 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260812 18:00:35.792763 20661 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: No bootstrap required, opened a new log
I20260812 18:00:35.793187 20661 ts_tablet_manager.cc:1397] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.008s
I20260812 18:00:35.795810 20661 raft_consensus.cc:348] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.796397 20661 raft_consensus.cc:374] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:35.796659 20661 raft_consensus.cc:729] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bff86d4e854e4ab7cf0d55869d630e, State: Initialized, Role: FOLLOWER
I20260812 18:00:35.797184 20661 consensus_queue.cc:260] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.799083 20453 heartbeater.cc:503] Master 127.17.37.126:40499 was elected leader, sending a full tablet report...
I20260812 18:00:35.799221 20661 ts_tablet_manager.cc:1428] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
W20260812 18:00:35.799522 20661 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260812 18:00:35.932142 20666 raft_consensus.cc:482] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:35.932667 20666 raft_consensus.cc:504] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.935047 20666 leader_election.cc:288] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109), 6403a978938c4cc0b78001a8f95ddb0a (127.17.37.66:39545)
I20260812 18:00:35.947059 20422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bc642ba10f4964b08a656455959767" candidate_uuid: "ce226085d52f4f10be71ad799d5470ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bff86d4e854e4ab7cf0d55869d630e" is_pre_election: true
I20260812 18:00:35.947813 20422 raft_consensus.cc:2454] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce226085d52f4f10be71ad799d5470ee in term 0.
I20260812 18:00:35.948808 20514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bc642ba10f4964b08a656455959767" candidate_uuid: "ce226085d52f4f10be71ad799d5470ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6403a978938c4cc0b78001a8f95ddb0a" is_pre_election: true
I20260812 18:00:35.948844 20565 leader_election.cc:302] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bff86d4e854e4ab7cf0d55869d630e, ce226085d52f4f10be71ad799d5470ee; no voters:
I20260812 18:00:35.949435 20514 raft_consensus.cc:2454] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce226085d52f4f10be71ad799d5470ee in term 0.
I20260812 18:00:35.949745 20666 raft_consensus.cc:2781] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 18:00:35.950057 20666 raft_consensus.cc:482] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:35.950344 20666 raft_consensus.cc:3037] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:35.954773 20666 raft_consensus.cc:504] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.956009 20666 leader_election.cc:288] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [CANDIDATE]: Term 1 election: Requested vote from peers 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109), 6403a978938c4cc0b78001a8f95ddb0a (127.17.37.66:39545)
I20260812 18:00:35.956815 20422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bc642ba10f4964b08a656455959767" candidate_uuid: "ce226085d52f4f10be71ad799d5470ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bff86d4e854e4ab7cf0d55869d630e"
I20260812 18:00:35.957043 20514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bc642ba10f4964b08a656455959767" candidate_uuid: "ce226085d52f4f10be71ad799d5470ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6403a978938c4cc0b78001a8f95ddb0a"
I20260812 18:00:35.957288 20422 raft_consensus.cc:3037] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:35.957681 20514 raft_consensus.cc:3037] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:35.964167 20514 raft_consensus.cc:2454] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce226085d52f4f10be71ad799d5470ee in term 1.
I20260812 18:00:35.964167 20422 raft_consensus.cc:2454] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce226085d52f4f10be71ad799d5470ee in term 1.
I20260812 18:00:35.965588 20561 leader_election.cc:302] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6403a978938c4cc0b78001a8f95ddb0a, ce226085d52f4f10be71ad799d5470ee; no voters:
I20260812 18:00:35.966255 20666 raft_consensus.cc:2781] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:35.967293 20666 raft_consensus.cc:686] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 LEADER]: Becoming Leader. State: Replica: ce226085d52f4f10be71ad799d5470ee, State: Running, Role: LEADER
I20260812 18:00:35.968055 20666 consensus_queue.cc:237] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:35.974941 20303 catalog_manager.cc:5495] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee reported cstate change: term changed from 0 to 1, leader changed from <none> to ce226085d52f4f10be71ad799d5470ee (127.17.37.67). New cstate: current_term: 1 leader_uuid: "ce226085d52f4f10be71ad799d5470ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:36.078154 20412 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:58806
I20260812 18:00:36.079761 20673 tablet_replica.cc:330] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: stopping tablet replica
I20260812 18:00:36.080497 20673 raft_consensus.cc:2229] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:36.080941 20673 raft_consensus.cc:2258] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.083084 20673 ts_tablet_manager.cc:1905] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 18:00:36.092900 20673 ts_tablet_manager.cc:1918] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260812 18:00:36.093247 20673 log.cc:1196] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root/wals/39bc642ba10f4964b08a656455959767
I20260812 18:00:36.096782 20674 ts_tablet_manager.cc:927] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Initiating tablet copy from peer ce226085d52f4f10be71ad799d5470ee (127.17.37.67:34653)
I20260812 18:00:36.098243 20674 tablet_copy_client.cc:316] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet copy: Beginning tablet copy session from remote peer at address 127.17.37.67:34653
I20260812 18:00:36.109406 20620 tablet_copy_service.cc:140] P ce226085d52f4f10be71ad799d5470ee: Received BeginTabletCopySession request for tablet 39bc642ba10f4964b08a656455959767 from peer 11bff86d4e854e4ab7cf0d55869d630e ({username='slave'} at 127.0.0.1:38512)
I20260812 18:00:36.109910 20620 tablet_copy_service.cc:161] P ce226085d52f4f10be71ad799d5470ee: Beginning new tablet copy session on tablet 39bc642ba10f4964b08a656455959767 from peer 11bff86d4e854e4ab7cf0d55869d630e at {username='slave'} at 127.0.0.1:38512: session id = 11bff86d4e854e4ab7cf0d55869d630e-39bc642ba10f4964b08a656455959767
I20260812 18:00:36.115144 20620 tablet_copy_source_session.cc:205] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 18:00:36.117367 20674 ts_tablet_manager.cc:1905] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 18:00:36.126364 20674 ts_tablet_manager.cc:1918] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260812 18:00:36.126933 20674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bc642ba10f4964b08a656455959767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:36.131378 20674 tablet_copy_client.cc:791] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet copy: Starting download of 0 data blocks...
I20260812 18:00:36.131824 20674 tablet_copy_client.cc:655] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet copy: Starting download of 1 WAL segments...
I20260812 18:00:36.133448 20303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45746:
table { table_id: "a0c2f679631741c8a62d3e4516f0ab72" table_name: "test-table" }
I20260812 18:00:36.134155 20303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45746:
table { table_id: "a0c2f679631741c8a62d3e4516f0ab72" table_name: "test-table" }
I20260812 18:00:36.135344 20674 tablet_copy_client.cc:531] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 18:00:36.141791 20674 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Bootstrap starting.
I20260812 18:00:36.144532 20303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: Sending DeleteTablet for 3 replicas of tablet 39bc642ba10f4964b08a656455959767
I20260812 18:00:36.146709 20503 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 18:00:36 UTC) from {username='slave'} at 127.0.0.1:44038
I20260812 18:00:36.146994 20594 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 18:00:36 UTC) from {username='slave'} at 127.0.0.1:38488
I20260812 18:00:36.147969 20412 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 18:00:36 UTC) from {username='slave'} at 127.0.0.1:58790
I20260812 18:00:36.148869 20677 tablet_replica.cc:330] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: stopping tablet replica
I20260812 18:00:36.150017 20677 raft_consensus.cc:2229] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 18:00:36.150425 20285 catalog_manager.cc:4821] TS 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109): delete failed for tablet 39bc642ba10f4964b08a656455959767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39bc642ba10f4964b08a656455959767 already in progress: copying tablet
I20260812 18:00:36.150770 20677 raft_consensus.cc:2258] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.152566 20678 tablet_replica.cc:330] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: stopping tablet replica
I20260812 18:00:36.153326 20678 raft_consensus.cc:2229] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:36.153712 20677 ts_tablet_manager.cc:1905] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 18:00:36.154170 20678 pending_rounds.cc:62] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Trying to abort 1 pending ops.
I20260812 18:00:36.154459 20678 pending_rounds.cc:68] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317740076932497408 op_type: NO_OP noop_request { }
I20260812 18:00:36.154954 20678 raft_consensus.cc:2866] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 18:00:36.155282 20678 raft_consensus.cc:2258] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.157125 20674 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 18:00:36.157985 20674 tablet_bootstrap.cc:492] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Bootstrap complete.
I20260812 18:00:36.158205 20678 ts_tablet_manager.cc:1905] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 18:00:36.158576 20674 ts_tablet_manager.cc:1397] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Time spent bootstrapping tablet: real 0.017s user 0.018s sys 0.001s
I20260812 18:00:36.160868 20674 raft_consensus.cc:348] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:36.161782 20674 raft_consensus.cc:729] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bff86d4e854e4ab7cf0d55869d630e, State: Initialized, Role: FOLLOWER
I20260812 18:00:36.162585 20674 consensus_queue.cc:260] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bff86d4e854e4ab7cf0d55869d630e" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 42109 } } peers { permanent_uuid: "6403a978938c4cc0b78001a8f95ddb0a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39545 } } peers { permanent_uuid: "ce226085d52f4f10be71ad799d5470ee" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 34653 } }
I20260812 18:00:36.164522 20674 ts_tablet_manager.cc:1428] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
W20260812 18:00:36.164765 20674 ts_tablet_manager.cc:1450] Injecting 50ms of latency into OpenTablet
I20260812 18:00:36.168815 20677 ts_tablet_manager.cc:1918] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 18:00:36.169241 20677 log.cc:1196] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-1-root/wals/39bc642ba10f4964b08a656455959767
I20260812 18:00:36.169999 20677 ts_tablet_manager.cc:1939] T 39bc642ba10f4964b08a656455959767 P 6403a978938c4cc0b78001a8f95ddb0a: Deleting consensus metadata
I20260812 18:00:36.170121 20412 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 18:00:36 UTC) from {username='slave'} at 127.0.0.1:58790
I20260812 18:00:36.172039 20678 ts_tablet_manager.cc:1918] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260812 18:00:36.172142 20285 catalog_manager.cc:4821] TS 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109): delete failed for tablet 39bc642ba10f4964b08a656455959767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39bc642ba10f4964b08a656455959767 already in progress: copying tablet
I20260812 18:00:36.172417 20678 log.cc:1196] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-2-root/wals/39bc642ba10f4964b08a656455959767
I20260812 18:00:36.173168 20678 ts_tablet_manager.cc:1939] T 39bc642ba10f4964b08a656455959767 P ce226085d52f4f10be71ad799d5470ee: Deleting consensus metadata
I20260812 18:00:36.173123 20280 catalog_manager.cc:4841] TS 6403a978938c4cc0b78001a8f95ddb0a (127.17.37.66:39545): tablet 39bc642ba10f4964b08a656455959767 (table test-table [id=a0c2f679631741c8a62d3e4516f0ab72]) successfully deleted
I20260812 18:00:36.174397 20285 catalog_manager.cc:4841] TS ce226085d52f4f10be71ad799d5470ee (127.17.37.67:34653): tablet 39bc642ba10f4964b08a656455959767 (table test-table [id=a0c2f679631741c8a62d3e4516f0ab72]) successfully deleted
I20260812 18:00:36.216632 20620 tablet_copy_service.cc:342] P ce226085d52f4f10be71ad799d5470ee: Request end of tablet copy session 11bff86d4e854e4ab7cf0d55869d630e-39bc642ba10f4964b08a656455959767 received from {username='slave'} at 127.0.0.1:38512
I20260812 18:00:36.217092 20620 tablet_copy_service.cc:433] P ce226085d52f4f10be71ad799d5470ee: ending tablet copy session 11bff86d4e854e4ab7cf0d55869d630e-39bc642ba10f4964b08a656455959767 on tablet 39bc642ba10f4964b08a656455959767 with peer 11bff86d4e854e4ab7cf0d55869d630e
I20260812 18:00:36.220021 20412 tablet_service.cc:1514] Processing DeleteTablet for tablet 39bc642ba10f4964b08a656455959767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 18:00:36 UTC) from {username='slave'} at 127.0.0.1:58790
I20260812 18:00:36.220724 20673 tablet_replica.cc:330] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: stopping tablet replica
I20260812 18:00:36.221294 20673 raft_consensus.cc:2229] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:36.221683 20673 pending_rounds.cc:62] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Trying to abort 1 pending ops.
I20260812 18:00:36.221896 20673 pending_rounds.cc:68] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317740076932497408 op_type: NO_OP noop_request { }
I20260812 18:00:36.222187 20673 raft_consensus.cc:2866] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 18:00:36.222450 20673 raft_consensus.cc:2258] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.224166 20673 ts_tablet_manager.cc:1905] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 18:00:36.233250 20673 ts_tablet_manager.cc:1918] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 18:00:36.233532 20673 log.cc:1196] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786557580379316-17557-0/minicluster-data/ts-0-root/wals/39bc642ba10f4964b08a656455959767
I20260812 18:00:36.234127 20673 ts_tablet_manager.cc:1939] T 39bc642ba10f4964b08a656455959767 P 11bff86d4e854e4ab7cf0d55869d630e: Deleting consensus metadata
I20260812 18:00:36.236085 20285 catalog_manager.cc:4841] TS 11bff86d4e854e4ab7cf0d55869d630e (127.17.37.65:42109): tablet 39bc642ba10f4964b08a656455959767 (table test-table [id=a0c2f679631741c8a62d3e4516f0ab72]) successfully deleted
I20260812 18:00:36.283340 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:36.302718 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:36.319562 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:36.328632 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 18:00:36.346740 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:36.363245 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 18:00:36.371722 17557 tablet_server.cc:178] TabletServer@127.17.37.67:0 shutting down...
I20260812 18:00:36.387948 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:36.403983 17557 tablet_server.cc:194] TabletServer@127.17.37.67:0 shutdown complete.
I20260812 18:00:36.412695 17557 master.cc:537] Master@127.17.37.126:40499 shutting down...
I20260812 18:00:36.426380 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:36.426798 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.427110 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P aabf4bcccbdc417ebe5628822d4c5fcc: stopping tablet replica
I20260812 18:00:36.435232 17557 master.cc:552] Master@127.17.37.126:40499 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1311 ms)
[----------] 4 tests from TsTabletManagerITest (45370 ms total)
[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260812 18:00:36.458513 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:38243
I20260812 18:00:36.459512 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:36.464355 20684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:36.465587 20685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:36.466661 20689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:36.467674 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:36.468300 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:36.468449 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:36.468640 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557636468606 us; error 0 us; skew 500 ppm
I20260812 18:00:36.469236 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:36.471673 17557 webserver.cc:460] Webserver started at http://127.17.37.126:34075/ using document root <none> and password file <none>
I20260812 18:00:36.472146 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:36.472330 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:36.472604 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:36.473699 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "8def2239e633472c8a054d104a78eae7"
format_stamp: "Formatted at 2026-08-12 18:00:36 on dist-test-slave-6nmv"
I20260812 18:00:36.478019 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 18:00:36.481230 20694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:36.481946 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:36.482192 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "8def2239e633472c8a054d104a78eae7"
format_stamp: "Formatted at 2026-08-12 18:00:36 on dist-test-slave-6nmv"
I20260812 18:00:36.482458 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:36.502357 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:36.503242 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:36.535310 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:38243
I20260812 18:00:36.535405 20760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:38243 every 8 connection(s)
I20260812 18:00:36.538594 20761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:36.547358 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7: Bootstrap starting.
I20260812 18:00:36.551131 20761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:36.554626 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7: No bootstrap required, opened a new log
I20260812 18:00:36.556608 20761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER }
I20260812 18:00:36.556948 20761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:36.557107 20761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8def2239e633472c8a054d104a78eae7, State: Initialized, Role: FOLLOWER
I20260812 18:00:36.557530 20761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER }
I20260812 18:00:36.557924 20761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:36.558087 20761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:36.558274 20761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:36.561793 20761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER }
I20260812 18:00:36.562204 20761 leader_election.cc:302] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8def2239e633472c8a054d104a78eae7; no voters:
I20260812 18:00:36.563156 20761 leader_election.cc:288] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:36.563406 20764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:36.564685 20764 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 1 LEADER]: Becoming Leader. State: Replica: 8def2239e633472c8a054d104a78eae7, State: Running, Role: LEADER
I20260812 18:00:36.565243 20764 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER }
I20260812 18:00:36.565790 20761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:36.569387 20766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8def2239e633472c8a054d104a78eae7. Latest consensus state: current_term: 1 leader_uuid: "8def2239e633472c8a054d104a78eae7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER } }
I20260812 18:00:36.569438 20765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8def2239e633472c8a054d104a78eae7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def2239e633472c8a054d104a78eae7" member_type: VOTER } }
I20260812 18:00:36.570140 20766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:36.570217 20765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:36.572875 20771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:36.577145 20771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:36.580395 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:36.584930 20771 catalog_manager.cc:1347] Generated new cluster ID: bb8e54c08cd343b0a0d6aae4ab8e01fa
I20260812 18:00:36.585194 20771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:36.597533 20771 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:36.598960 20771 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:36.615401 20771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7: Generated new TSK 0
I20260812 18:00:36.615913 20771 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:36.646306 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:36.651674 20782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:36.652103 20784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:36.654237 20786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:36.656598 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:36.657259 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:36.657423 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:36.657593 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557636657583 us; error 0 us; skew 500 ppm
I20260812 18:00:36.658074 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:36.660168 17557 webserver.cc:460] Webserver started at http://127.17.37.65:43265/ using document root <none> and password file <none>
I20260812 18:00:36.660615 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:36.660765 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:36.660954 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:36.662017 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "d63b486412954135beb067a2e96e4135"
format_stamp: "Formatted at 2026-08-12 18:00:36 on dist-test-slave-6nmv"
I20260812 18:00:36.665803 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 18:00:36.668525 20792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:36.669196 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 18:00:36.669409 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "d63b486412954135beb067a2e96e4135"
format_stamp: "Formatted at 2026-08-12 18:00:36 on dist-test-slave-6nmv"
I20260812 18:00:36.669626 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:36.695456 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:36.696484 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:36.702515 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:36.702817 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:36.703061 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:36.703226 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:36.752940 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:38947
I20260812 18:00:36.753052 20878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:38947 every 8 connection(s)
I20260812 18:00:36.757911 20879 heartbeater.cc:347] Connected to a master server at 127.17.37.126:38243
I20260812 18:00:36.758306 20879 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:36.759047 20879 heartbeater.cc:511] Master 127.17.37.126:38243 requested a full tablet report, sending...
I20260812 18:00:36.761225 20718 ts_manager.cc:194] Registered new tserver with Master: d63b486412954135beb067a2e96e4135 (127.17.37.65:38947)
I20260812 18:00:36.761312 17557 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004910345s
I20260812 18:00:36.763177 20718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41336
I20260812 18:00:36.797271 20838 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260812 18:00:36.798578 20838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:36.809870 20894 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Bootstrap starting.
I20260812 18:00:36.813999 20894 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:36.817762 20894 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: No bootstrap required, opened a new log
I20260812 18:00:36.818192 20894 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 18:00:36.819921 20894 raft_consensus.cc:348] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:36.820282 20894 raft_consensus.cc:374] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:36.820590 20894 raft_consensus.cc:729] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63b486412954135beb067a2e96e4135, State: Initialized, Role: FOLLOWER
I20260812 18:00:36.821094 20894 consensus_queue.cc:260] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:36.821542 20894 raft_consensus.cc:388] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:36.821790 20894 raft_consensus.cc:482] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:36.822103 20894 raft_consensus.cc:3037] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:36.826228 20894 raft_consensus.cc:504] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:36.826721 20894 leader_election.cc:302] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d63b486412954135beb067a2e96e4135; no voters:
I20260812 18:00:36.827819 20894 leader_election.cc:288] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:36.828161 20896 raft_consensus.cc:2781] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:36.829572 20896 raft_consensus.cc:686] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 LEADER]: Becoming Leader. State: Replica: d63b486412954135beb067a2e96e4135, State: Running, Role: LEADER
I20260812 18:00:36.829646 20879 heartbeater.cc:503] Master 127.17.37.126:38243 was elected leader, sending a full tablet report...
I20260812 18:00:36.830107 20894 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 18:00:36.830375 20896 consensus_queue.cc:237] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:36.835876 20897 tablet_replica.cc:439] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d63b486412954135beb067a2e96e4135" committed_config { opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } } }
I20260812 18:00:36.836396 20897 tablet_replica.cc:442] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:36.836553 20898 tablet_replica.cc:439] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: TxnStatusTablet state changed. Reason: New leader d63b486412954135beb067a2e96e4135. Latest consensus state: current_term: 1 leader_uuid: "d63b486412954135beb067a2e96e4135" committed_config { opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } } }
I20260812 18:00:36.837069 20898 tablet_replica.cc:442] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:36.837970 20901 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 18:00:36.838550 20901 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260812 18:00:36.838584 20718 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260812 18:00:36.843842 20718 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:36.874434 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:36.896752 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:36.897977 17557 tablet_replica.cc:330] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: stopping tablet replica
I20260812 18:00:36.898864 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:36.899566 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:36.911441 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:36.924328 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:36.930578 20904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:36.930685 20906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:36.933290 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:36.933552 20908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:36.934495 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:36.934696 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:36.934873 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557636934859 us; error 0 us; skew 500 ppm
I20260812 18:00:36.935393 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:36.938045 17557 webserver.cc:460] Webserver started at http://127.17.37.65:43265/ using document root <none> and password file <none>
I20260812 18:00:36.938462 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:36.938635 17557 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260812 18:00:36.942049 17557 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 18:00:36.944664 20916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:36.945391 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 18:00:36.945645 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "d63b486412954135beb067a2e96e4135"
format_stamp: "Formatted at 2026-08-12 18:00:36 on dist-test-slave-6nmv"
I20260812 18:00:36.946034 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:36.965754 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:36.966619 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:36.974088 20925 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 18:00:36.982235 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 18:00:36.982532 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.001s sys 0.000s
I20260812 18:00:36.982851 17557 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 18:00:36.989199 17557 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 18:00:36.989444 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.007s user 0.003s sys 0.000s
I20260812 18:00:36.989792 20925 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Bootstrap starting.
I20260812 18:00:37.031057 20925 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 18:00:37.038225 20925 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Bootstrap complete.
I20260812 18:00:37.039332 20925 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Time spent bootstrapping tablet: real 0.050s user 0.028s sys 0.010s
I20260812 18:00:37.042022 20925 raft_consensus.cc:348] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:37.042635 20925 raft_consensus.cc:729] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63b486412954135beb067a2e96e4135, State: Initialized, Role: FOLLOWER
I20260812 18:00:37.043262 20925 consensus_queue.cc:260] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:37.043900 20925 raft_consensus.cc:388] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:37.044235 20925 raft_consensus.cc:482] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:37.044615 20925 raft_consensus.cc:3037] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:37.052170 20925 raft_consensus.cc:504] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:37.052763 20925 leader_election.cc:302] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d63b486412954135beb067a2e96e4135; no voters:
I20260812 18:00:37.059026 20925 leader_election.cc:288] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 18:00:37.059419 20939 raft_consensus.cc:2781] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 18:00:37.071755 20939 raft_consensus.cc:686] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 2 LEADER]: Becoming Leader. State: Replica: d63b486412954135beb067a2e96e4135, State: Running, Role: LEADER
I20260812 18:00:37.071887 20925 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135: Time spent starting tablet: real 0.032s user 0.014s sys 0.015s
I20260812 18:00:37.072744 20939 consensus_queue.cc:237] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } }
I20260812 18:00:37.076848 20944 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader d63b486412954135beb067a2e96e4135. Latest consensus state: current_term: 2 leader_uuid: "d63b486412954135beb067a2e96e4135" committed_config { opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } } }
I20260812 18:00:37.077507 20944 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:37.083592 20942 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d63b486412954135beb067a2e96e4135" committed_config { opid_index: -1 peers { permanent_uuid: "d63b486412954135beb067a2e96e4135" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 38947 } } }
I20260812 18:00:37.084084 20942 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:37.085220 20957 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 18:00:37.085853 20957 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 18:00:37.120915 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:38947
I20260812 18:00:37.120975 21010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:38947 every 8 connection(s)
I20260812 18:00:37.126690 21011 heartbeater.cc:347] Connected to a master server at 127.17.37.126:38243
I20260812 18:00:37.127080 21011 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:37.128185 21011 heartbeater.cc:511] Master 127.17.37.126:38243 requested a full tablet report, sending...
I20260812 18:00:37.128240 17557 tablet_server.cc:178] TabletServer@127.17.37.65:38947 shutting down...
I20260812 18:00:37.133714 20718 ts_manager.cc:194] Re-registered known tserver with Master: d63b486412954135beb067a2e96e4135 (127.17.37.65:38947)
W20260812 18:00:37.134243 20718 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:37.135618 20718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41368
I20260812 18:00:37.139123 21011 heartbeater.cc:503] Master 127.17.37.126:38243 was elected leader, sending a full tablet report...
W20260812 18:00:37.141872 20718 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:37.152518 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:37.153215 17557 tablet_replica.cc:330] stopping tablet replica
I20260812 18:00:37.153744 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 2 LEADER]: Raft consensus shutting down.
I20260812 18:00:37.154199 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P d63b486412954135beb067a2e96e4135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:37.174404 17557 tablet_server.cc:194] TabletServer@127.17.37.65:38947 shutdown complete.
I20260812 18:00:37.184774 17557 master.cc:537] Master@127.17.37.126:38243 shutting down...
I20260812 18:00:37.201211 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:37.201782 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:37.202165 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8def2239e633472c8a054d104a78eae7: stopping tablet replica
I20260812 18:00:37.219831 17557 master.cc:552] Master@127.17.37.126:38243 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (783 ms)
[ RUN ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260812 18:00:37.242549 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:44649
I20260812 18:00:37.243510 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:37.248593 21019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.249049 21020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.251739 21022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:37.253506 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:37.254204 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:37.254403 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:37.254561 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557637254547 us; error 0 us; skew 500 ppm
I20260812 18:00:37.255113 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:37.257737 17557 webserver.cc:460] Webserver started at http://127.17.37.126:40311/ using document root <none> and password file <none>
I20260812 18:00:37.258239 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:37.258437 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:37.258726 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:37.259789 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "a065a24f2d7c4f479f20768385ec59b4"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.264178 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 18:00:37.267347 21027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.268175 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 18:00:37.268468 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "a065a24f2d7c4f479f20768385ec59b4"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.268781 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:37.306162 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:37.307340 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:37.358247 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:44649
I20260812 18:00:37.358335 21088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:44649 every 8 connection(s)
I20260812 18:00:37.362680 21089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:37.372828 21089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4: Bootstrap starting.
I20260812 18:00:37.376829 21089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:37.380666 21089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4: No bootstrap required, opened a new log
I20260812 18:00:37.382550 21089 raft_consensus.cc:348] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER }
I20260812 18:00:37.382898 21089 raft_consensus.cc:374] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:37.383147 21089 raft_consensus.cc:729] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a065a24f2d7c4f479f20768385ec59b4, State: Initialized, Role: FOLLOWER
I20260812 18:00:37.383733 21089 consensus_queue.cc:260] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER }
I20260812 18:00:37.384186 21089 raft_consensus.cc:388] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:37.384385 21089 raft_consensus.cc:482] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:37.384665 21089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:37.388648 21089 raft_consensus.cc:504] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER }
I20260812 18:00:37.389134 21089 leader_election.cc:302] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a065a24f2d7c4f479f20768385ec59b4; no voters:
I20260812 18:00:37.390460 21089 leader_election.cc:288] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:37.390754 21094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:37.392496 21094 raft_consensus.cc:686] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 1 LEADER]: Becoming Leader. State: Replica: a065a24f2d7c4f479f20768385ec59b4, State: Running, Role: LEADER
I20260812 18:00:37.393168 21094 consensus_queue.cc:237] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER }
I20260812 18:00:37.393847 21089 sys_catalog.cc:564] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:37.395884 21095 sys_catalog.cc:455] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a065a24f2d7c4f479f20768385ec59b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER } }
I20260812 18:00:37.396005 21096 sys_catalog.cc:455] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a065a24f2d7c4f479f20768385ec59b4. Latest consensus state: current_term: 1 leader_uuid: "a065a24f2d7c4f479f20768385ec59b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a065a24f2d7c4f479f20768385ec59b4" member_type: VOTER } }
I20260812 18:00:37.396376 21095 sys_catalog.cc:458] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:37.396541 21096 sys_catalog.cc:458] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:37.398820 21100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:37.407025 21100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:37.418095 21100 catalog_manager.cc:1347] Generated new cluster ID: a9e07347e3464e71a8b8c8b518120704
I20260812 18:00:37.418334 21100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:37.420439 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:37.446492 21100 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:37.448792 21100 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:37.467124 21100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4: Generated new TSK 0
I20260812 18:00:37.467754 21100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:37.486497 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:37.492389 21117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.496170 21120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.495285 21118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:37.499373 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:37.500459 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:37.500707 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:37.500875 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557637500859 us; error 0 us; skew 500 ppm
I20260812 18:00:37.501387 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:37.504166 17557 webserver.cc:460] Webserver started at http://127.17.37.65:42127/ using document root <none> and password file <none>
I20260812 18:00:37.504621 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:37.504817 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:37.505081 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:37.506198 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "90db067c04c548bc8c27e8f0445df7c8"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.510470 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 18:00:37.513931 21127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.514854 17557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 18:00:37.515126 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "90db067c04c548bc8c27e8f0445df7c8"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.515362 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:37.537077 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:37.538017 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:37.545849 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:37.546118 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.546377 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:37.546530 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.617810 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:41499
I20260812 18:00:37.617993 21209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:41499 every 8 connection(s)
I20260812 18:00:37.623483 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 18:00:37.623732 21212 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44649
I20260812 18:00:37.624140 21212 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:37.624789 21212 heartbeater.cc:511] Master 127.17.37.126:44649 requested a full tablet report, sending...
I20260812 18:00:37.626593 21050 ts_manager.cc:194] Registered new tserver with Master: 90db067c04c548bc8c27e8f0445df7c8 (127.17.37.65:41499)
I20260812 18:00:37.628710 21050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50618
W20260812 18:00:37.630501 21215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.632149 21216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:37.635454 21219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:37.635692 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:37.636587 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:37.636827 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:37.637017 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557637637002 us; error 0 us; skew 500 ppm
I20260812 18:00:37.637676 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:37.640286 17557 webserver.cc:460] Webserver started at http://127.17.37.66:43239/ using document root <none> and password file <none>
I20260812 18:00:37.640873 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:37.641109 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:37.641409 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:37.642769 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "037e21c40f3d4f059f37df3c06270479"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.648284 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260812 18:00:37.652145 21224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.652958 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 18:00:37.653256 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "037e21c40f3d4f059f37df3c06270479"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:37.653559 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:37.680279 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:37.681725 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:37.688068 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:37.688361 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 18:00:37.688647 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:37.688860 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:37.763069 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:33269
I20260812 18:00:37.763149 21309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:33269 every 8 connection(s)
I20260812 18:00:37.768304 21310 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44649
I20260812 18:00:37.768712 21310 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:37.769510 21310 heartbeater.cc:511] Master 127.17.37.126:44649 requested a full tablet report, sending...
I20260812 18:00:37.771565 21050 ts_manager.cc:194] Registered new tserver with Master: 037e21c40f3d4f059f37df3c06270479 (127.17.37.66:33269)
I20260812 18:00:37.772082 17557 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.005012417s
I20260812 18:00:37.773250 21050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50640
I20260812 18:00:37.810922 21168 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260812 18:00:37.812080 21168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:37.823064 21322 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Bootstrap starting.
I20260812 18:00:37.827186 21322 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:37.831175 21322 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: No bootstrap required, opened a new log
I20260812 18:00:37.831537 21322 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 18:00:37.833477 21322 raft_consensus.cc:348] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.834009 21322 raft_consensus.cc:374] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:37.834272 21322 raft_consensus.cc:729] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90db067c04c548bc8c27e8f0445df7c8, State: Initialized, Role: FOLLOWER
I20260812 18:00:37.834789 21322 consensus_queue.cc:260] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.835273 21322 raft_consensus.cc:388] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:37.835471 21322 raft_consensus.cc:482] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:37.835757 21322 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:37.839792 21322 raft_consensus.cc:504] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.840372 21322 leader_election.cc:302] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90db067c04c548bc8c27e8f0445df7c8; no voters:
I20260812 18:00:37.841765 21322 leader_election.cc:288] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:37.842137 21324 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:37.843793 21212 heartbeater.cc:503] Master 127.17.37.126:44649 was elected leader, sending a full tablet report...
I20260812 18:00:37.843895 21324 raft_consensus.cc:686] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 LEADER]: Becoming Leader. State: Replica: 90db067c04c548bc8c27e8f0445df7c8, State: Running, Role: LEADER
I20260812 18:00:37.844640 21324 consensus_queue.cc:237] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.845359 21322 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260812 18:00:37.848081 21325 tablet_replica.cc:439] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90db067c04c548bc8c27e8f0445df7c8" committed_config { opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } } }
I20260812 18:00:37.848306 21326 tablet_replica.cc:439] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: TxnStatusTablet state changed. Reason: New leader 90db067c04c548bc8c27e8f0445df7c8. Latest consensus state: current_term: 1 leader_uuid: "90db067c04c548bc8c27e8f0445df7c8" committed_config { opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } } }
I20260812 18:00:37.848904 21326 tablet_replica.cc:442] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:37.848618 21325 tablet_replica.cc:442] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:37.850431 21329 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
W20260812 18:00:37.850427 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:37.851220 21329 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260812 18:00:37.856256 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:37.909775 21335 ts_tablet_manager.cc:927] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Initiating tablet copy from peer 90db067c04c548bc8c27e8f0445df7c8 (127.17.37.65:41499)
I20260812 18:00:37.911368 21335 tablet_copy_client.cc:316] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: tablet copy: Beginning tablet copy session from remote peer at address 127.17.37.65:41499
I20260812 18:00:37.921398 21193 tablet_copy_service.cc:140] P 90db067c04c548bc8c27e8f0445df7c8: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer 037e21c40f3d4f059f37df3c06270479 ({username='slave'} at 127.0.0.1:38616)
I20260812 18:00:37.921976 21193 tablet_copy_service.cc:161] P 90db067c04c548bc8c27e8f0445df7c8: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer 037e21c40f3d4f059f37df3c06270479 at {username='slave'} at 127.0.0.1:38616: session id = 037e21c40f3d4f059f37df3c06270479-11111111111111111111111111111111
I20260812 18:00:37.927105 21193 tablet_copy_source_session.cc:205] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 18:00:37.929435 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:37.938526 21335 tablet_copy_client.cc:791] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: tablet copy: Starting download of 0 data blocks...
I20260812 18:00:37.939009 21335 tablet_copy_client.cc:655] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: tablet copy: Starting download of 1 WAL segments...
I20260812 18:00:37.942456 21335 tablet_copy_client.cc:531] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 18:00:37.947362 21335 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Bootstrap starting.
I20260812 18:00:37.967908 21335 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 18:00:37.968508 21335 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Bootstrap complete.
I20260812 18:00:37.969017 21335 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.002s
I20260812 18:00:37.971233 21335 raft_consensus.cc:348] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.971855 21335 raft_consensus.cc:729] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 037e21c40f3d4f059f37df3c06270479, State: Initialized, Role: NON_PARTICIPANT
I20260812 18:00:37.972306 21335 consensus_queue.cc:260] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:37.974102 21310 heartbeater.cc:503] Master 127.17.37.126:44649 was elected leader, sending a full tablet report...
I20260812 18:00:37.973896 21339 tablet_replica.cc:439] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } } }
I20260812 18:00:37.974567 21339 tablet_replica.cc:442] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260812 18:00:37.974675 21335 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260812 18:00:37.976660 21193 tablet_copy_service.cc:342] P 90db067c04c548bc8c27e8f0445df7c8: Request end of tablet copy session 037e21c40f3d4f059f37df3c06270479-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:38616
W20260812 18:00:37.976881 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:37.976996 21193 tablet_copy_service.cc:433] P 90db067c04c548bc8c27e8f0445df7c8: ending tablet copy session 037e21c40f3d4f059f37df3c06270479-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer 037e21c40f3d4f059f37df3c06270479
W20260812 18:00:37.980718 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:38.003402 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:38.033449 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:38.035239 17557 tablet_replica.cc:330] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: stopping tablet replica
I20260812 18:00:38.035913 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:38.036463 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:38.049764 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:38.063858 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:38.070366 21340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:38.072196 21341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:38.073559 21343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:38.073908 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:38.074924 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:38.075132 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:38.075304 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557638075275 us; error 0 us; skew 500 ppm
I20260812 18:00:38.075932 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:38.078657 17557 webserver.cc:460] Webserver started at http://127.17.37.65:42127/ using document root <none> and password file <none>
I20260812 18:00:38.079078 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:38.079238 17557 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260812 18:00:38.082731 17557 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 18:00:38.085454 21349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:38.086304 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:38.086571 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "90db067c04c548bc8c27e8f0445df7c8"
format_stamp: "Formatted at 2026-08-12 18:00:37 on dist-test-slave-6nmv"
I20260812 18:00:38.086841 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:38.108542 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:38.109402 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:38.116376 21358 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 18:00:38.124528 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 18:00:38.124871 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.001s sys 0.000s
I20260812 18:00:38.125165 17557 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 18:00:38.131356 17557 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 18:00:38.131577 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.006s user 0.006s sys 0.000s
I20260812 18:00:38.131695 21358 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Bootstrap starting.
I20260812 18:00:38.171360 21358 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 18:00:38.172338 21358 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Bootstrap complete.
I20260812 18:00:38.173048 21358 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Time spent bootstrapping tablet: real 0.042s user 0.024s sys 0.016s
I20260812 18:00:38.175542 21358 raft_consensus.cc:348] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:38.176087 21358 raft_consensus.cc:729] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90db067c04c548bc8c27e8f0445df7c8, State: Initialized, Role: FOLLOWER
I20260812 18:00:38.176779 21358 consensus_queue.cc:260] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:38.177388 21358 raft_consensus.cc:388] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:38.177690 21358 raft_consensus.cc:482] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:38.178031 21358 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:38.184401 21358 raft_consensus.cc:504] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:38.184999 21358 leader_election.cc:302] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90db067c04c548bc8c27e8f0445df7c8; no voters:
I20260812 18:00:38.192586 21387 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 18:00:38.193046 21358 leader_election.cc:288] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 18:00:38.203630 21358 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8: Time spent starting tablet: real 0.030s user 0.021s sys 0.007s
I20260812 18:00:38.205389 21387 raft_consensus.cc:686] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 2 LEADER]: Becoming Leader. State: Replica: 90db067c04c548bc8c27e8f0445df7c8, State: Running, Role: LEADER
I20260812 18:00:38.206231 21387 consensus_queue.cc:237] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } }
I20260812 18:00:38.210084 21391 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "90db067c04c548bc8c27e8f0445df7c8" committed_config { opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } } }
I20260812 18:00:38.210572 21391 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:38.210199 21393 tablet_replica.cc:439] TxnStatusTablet state changed. Reason: New leader 90db067c04c548bc8c27e8f0445df7c8. Latest consensus state: current_term: 2 leader_uuid: "90db067c04c548bc8c27e8f0445df7c8" committed_config { opid_index: -1 peers { permanent_uuid: "90db067c04c548bc8c27e8f0445df7c8" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 41499 } } }
I20260812 18:00:38.211138 21393 tablet_replica.cc:442] This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:38.225107 21402 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 18:00:38.225539 21402 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 18:00:38.250420 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:41499
I20260812 18:00:38.250526 21446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:41499 every 8 connection(s)
I20260812 18:00:38.255573 21447 heartbeater.cc:347] Connected to a master server at 127.17.37.126:44649
I20260812 18:00:38.256013 21447 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:38.256832 21447 heartbeater.cc:511] Master 127.17.37.126:44649 requested a full tablet report, sending...
I20260812 18:00:38.259953 21050 ts_manager.cc:194] Re-registered known tserver with Master: 90db067c04c548bc8c27e8f0445df7c8 (127.17.37.65:41499)
I20260812 18:00:38.260288 17557 tablet_server.cc:178] TabletServer@127.17.37.65:41499 shutting down...
W20260812 18:00:38.260456 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:38.263924 21050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50674
I20260812 18:00:38.267493 21447 heartbeater.cc:503] Master 127.17.37.126:44649 was elected leader, sending a full tablet report...
W20260812 18:00:38.270726 21050 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:38.289698 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:38.290479 17557 tablet_replica.cc:330] stopping tablet replica
I20260812 18:00:38.291257 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 2 LEADER]: Raft consensus shutting down.
I20260812 18:00:38.291813 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 90db067c04c548bc8c27e8f0445df7c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:38.312884 17557 tablet_server.cc:194] TabletServer@127.17.37.65:41499 shutdown complete.
I20260812 18:00:38.325037 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 18:00:38.343631 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:38.344588 17557 tablet_replica.cc:330] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479: stopping tablet replica
I20260812 18:00:38.345275 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260812 18:00:38.345739 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 037e21c40f3d4f059f37df3c06270479 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 18:00:38.366227 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 18:00:38.379776 17557 master.cc:537] Master@127.17.37.126:44649 shutting down...
I20260812 18:00:38.395925 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:38.396575 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:38.396888 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P a065a24f2d7c4f479f20768385ec59b4: stopping tablet replica
I20260812 18:00:38.415755 17557 master.cc:552] Master@127.17.37.126:44649 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1196 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260812 18:00:38.439808 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:40583
I20260812 18:00:38.440821 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:38.446174 21454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:38.446362 21455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:38.449668 21457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:38.450230 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:38.451012 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:38.451179 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:38.451361 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557638451350 us; error 0 us; skew 500 ppm
I20260812 18:00:38.451942 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:38.454737 17557 webserver.cc:460] Webserver started at http://127.17.37.126:44429/ using document root <none> and password file <none>
I20260812 18:00:38.455189 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:38.455358 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:38.455622 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:38.456655 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "b90f463a31494e68bd39968d94ac734d"
format_stamp: "Formatted at 2026-08-12 18:00:38 on dist-test-slave-6nmv"
I20260812 18:00:38.461237 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 18:00:38.464807 21464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:38.465639 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:38.465997 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "b90f463a31494e68bd39968d94ac734d"
format_stamp: "Formatted at 2026-08-12 18:00:38 on dist-test-slave-6nmv"
I20260812 18:00:38.466343 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:38.480703 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:38.482055 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:38.527822 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:40583
I20260812 18:00:38.527900 21527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:40583 every 8 connection(s)
I20260812 18:00:38.532673 21529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:38.542515 21529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d: Bootstrap starting.
I20260812 18:00:38.546487 21529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:38.550463 21529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d: No bootstrap required, opened a new log
I20260812 18:00:38.552263 21529 raft_consensus.cc:348] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER }
I20260812 18:00:38.552626 21529 raft_consensus.cc:374] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:38.552871 21529 raft_consensus.cc:729] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b90f463a31494e68bd39968d94ac734d, State: Initialized, Role: FOLLOWER
I20260812 18:00:38.553504 21529 consensus_queue.cc:260] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER }
I20260812 18:00:38.554003 21529 raft_consensus.cc:388] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:38.554200 21529 raft_consensus.cc:482] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:38.554481 21529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:38.558435 21529 raft_consensus.cc:504] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER }
I20260812 18:00:38.558956 21529 leader_election.cc:302] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b90f463a31494e68bd39968d94ac734d; no voters:
I20260812 18:00:38.560333 21529 leader_election.cc:288] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:38.560638 21532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:38.562366 21532 raft_consensus.cc:686] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 1 LEADER]: Becoming Leader. State: Replica: b90f463a31494e68bd39968d94ac734d, State: Running, Role: LEADER
I20260812 18:00:38.563061 21532 consensus_queue.cc:237] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER }
I20260812 18:00:38.563812 21529 sys_catalog.cc:564] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:38.565928 21533 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b90f463a31494e68bd39968d94ac734d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER } }
I20260812 18:00:38.565995 21534 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b90f463a31494e68bd39968d94ac734d. Latest consensus state: current_term: 1 leader_uuid: "b90f463a31494e68bd39968d94ac734d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90f463a31494e68bd39968d94ac734d" member_type: VOTER } }
I20260812 18:00:38.566509 21533 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:38.566628 21534 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:38.575414 21538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:38.583042 21538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:38.585162 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:38.592159 21538 catalog_manager.cc:1347] Generated new cluster ID: 796a11af64d34566b85039d40d8b1ff2
I20260812 18:00:38.592433 21538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:38.623811 21538 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:38.626238 21538 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:38.647493 21538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d: Generated new TSK 0
I20260812 18:00:38.648195 21538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:38.715857 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:38.722153 21555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:38.723798 21556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:38.731108 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:38.731736 21558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:38.732779 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:38.733079 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:38.733273 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557638733258 us; error 0 us; skew 500 ppm
I20260812 18:00:38.733935 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:38.736744 17557 webserver.cc:460] Webserver started at http://127.17.37.65:46677/ using document root <none> and password file <none>
I20260812 18:00:38.737340 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:38.737564 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:38.737891 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:38.739286 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "8a39ed5c4741483181fa8925afc30272"
format_stamp: "Formatted at 2026-08-12 18:00:38 on dist-test-slave-6nmv"
I20260812 18:00:38.745141 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 18:00:38.749209 21565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:38.750041 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:38.750355 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "8a39ed5c4741483181fa8925afc30272"
format_stamp: "Formatted at 2026-08-12 18:00:38 on dist-test-slave-6nmv"
I20260812 18:00:38.750733 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:38.793552 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:38.794818 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:38.801256 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:38.801604 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 18:00:38.802016 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:38.802239 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:38.865783 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:37471
I20260812 18:00:38.865923 21646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:37471 every 8 connection(s)
I20260812 18:00:38.870905 21647 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40583
I20260812 18:00:38.871271 21647 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:38.871944 21647 heartbeater.cc:511] Master 127.17.37.126:40583 requested a full tablet report, sending...
I20260812 18:00:38.873688 21483 ts_manager.cc:194] Registered new tserver with Master: 8a39ed5c4741483181fa8925afc30272 (127.17.37.65:37471)
I20260812 18:00:38.874503 17557 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004944821s
I20260812 18:00:38.875560 21483 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57364
I20260812 18:00:38.910888 21602 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260812 18:00:38.912094 21602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:38.922683 21659 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: Bootstrap starting.
I20260812 18:00:38.926741 21659 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:38.930622 21659 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: No bootstrap required, opened a new log
I20260812 18:00:38.931027 21659 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 18:00:38.932914 21659 raft_consensus.cc:348] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } }
I20260812 18:00:38.933346 21659 raft_consensus.cc:374] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:38.933568 21659 raft_consensus.cc:729] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a39ed5c4741483181fa8925afc30272, State: Initialized, Role: FOLLOWER
I20260812 18:00:38.934151 21659 consensus_queue.cc:260] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } }
I20260812 18:00:38.934638 21659 raft_consensus.cc:388] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:38.934880 21659 raft_consensus.cc:482] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:38.935169 21659 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:38.939752 21659 raft_consensus.cc:504] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } }
I20260812 18:00:38.940250 21659 leader_election.cc:302] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a39ed5c4741483181fa8925afc30272; no voters:
I20260812 18:00:38.941651 21659 leader_election.cc:288] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:38.942040 21661 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:38.943590 21647 heartbeater.cc:503] Master 127.17.37.126:40583 was elected leader, sending a full tablet report...
I20260812 18:00:38.944341 21659 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: Time spent starting tablet: real 0.013s user 0.004s sys 0.009s
I20260812 18:00:38.944669 21661 raft_consensus.cc:686] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 1 LEADER]: Becoming Leader. State: Replica: 8a39ed5c4741483181fa8925afc30272, State: Running, Role: LEADER
I20260812 18:00:38.945328 21661 consensus_queue.cc:237] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } }
I20260812 18:00:38.948186 21662 tablet_replica.cc:439] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a39ed5c4741483181fa8925afc30272" committed_config { opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } } }
I20260812 18:00:38.948704 21662 tablet_replica.cc:442] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: This TxnStatusTablet replica's current role is: LEADER
W20260812 18:00:38.950309 21483 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:38.956393 21669 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 18:00:38.956280 21663 tablet_replica.cc:439] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: TxnStatusTablet state changed. Reason: New leader 8a39ed5c4741483181fa8925afc30272. Latest consensus state: current_term: 1 leader_uuid: "8a39ed5c4741483181fa8925afc30272" committed_config { opid_index: -1 peers { permanent_uuid: "8a39ed5c4741483181fa8925afc30272" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 37471 } } }
I20260812 18:00:38.956905 21663 tablet_replica.cc:442] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:38.957260 21669 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260812 18:00:38.958145 21483 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260812 18:00:39.009529 21596 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260812 18:00:39.009948 21596 txn_status_manager.cc:243] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260812 18:00:39.010332 21596 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260812 18:00:39.018656 21596 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260812 18:00:39.062305 21596 txn_status_manager.cc:243] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260812 18:00:39.062611 21596 txn_status_manager.cc:205] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260812 18:00:39.070384 21596 txn_status_manager.cc:336] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260812 18:00:39.088235 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.090375 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.092258 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.094107 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.095902 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.097791 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:48520
W20260812 18:00:39.109953 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
W20260812 18:00:39.111868 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
W20260812 18:00:39.113685 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
W20260812 18:00:39.115547 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
W20260812 18:00:39.117432 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
W20260812 18:00:39.119400 21602 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:48528
I20260812 18:00:39.122309 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:39.151316 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:39.152647 17557 tablet_replica.cc:330] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272: stopping tablet replica
I20260812 18:00:39.153286 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:39.153772 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 8a39ed5c4741483181fa8925afc30272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:39.178622 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:39.190814 17557 master.cc:537] Master@127.17.37.126:40583 shutting down...
I20260812 18:00:39.213406 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:39.213989 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:39.214309 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P b90f463a31494e68bd39968d94ac734d: stopping tablet replica
I20260812 18:00:39.231300 17557 master.cc:552] Master@127.17.37.126:40583 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (813 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260812 18:00:39.253155 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:37571
I20260812 18:00:39.254213 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:39.258724 21684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:39.259811 21685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:39.261711 21687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:39.262095 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:39.262809 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:39.263006 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:39.263170 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557639263154 us; error 0 us; skew 500 ppm
I20260812 18:00:39.263813 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:39.266198 17557 webserver.cc:460] Webserver started at http://127.17.37.126:45123/ using document root <none> and password file <none>
I20260812 18:00:39.266683 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:39.266883 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:39.267148 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:39.268205 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "52d8fd9edc0c435ea75d803ca7dd0cef"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.272527 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 18:00:39.275651 21692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:39.276357 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 18:00:39.276638 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "52d8fd9edc0c435ea75d803ca7dd0cef"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.276919 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:39.293738 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:39.294672 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:39.329535 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:37571
I20260812 18:00:39.329630 21749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:37571 every 8 connection(s)
I20260812 18:00:39.333125 21750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:39.342355 21750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef: Bootstrap starting.
I20260812 18:00:39.346514 21750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:39.350328 21750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef: No bootstrap required, opened a new log
I20260812 18:00:39.352327 21750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER }
I20260812 18:00:39.352721 21750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:39.352938 21750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52d8fd9edc0c435ea75d803ca7dd0cef, State: Initialized, Role: FOLLOWER
I20260812 18:00:39.353479 21750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER }
I20260812 18:00:39.353957 21750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:39.354200 21750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:39.354476 21750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:39.358500 21750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER }
I20260812 18:00:39.358963 21750 leader_election.cc:302] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52d8fd9edc0c435ea75d803ca7dd0cef; no voters:
I20260812 18:00:39.359994 21750 leader_election.cc:288] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:39.360291 21754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:39.361660 21754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 1 LEADER]: Becoming Leader. State: Replica: 52d8fd9edc0c435ea75d803ca7dd0cef, State: Running, Role: LEADER
I20260812 18:00:39.362345 21754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER }
I20260812 18:00:39.362950 21750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:39.365273 21757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52d8fd9edc0c435ea75d803ca7dd0cef. Latest consensus state: current_term: 1 leader_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER } }
I20260812 18:00:39.365221 21755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d8fd9edc0c435ea75d803ca7dd0cef" member_type: VOTER } }
I20260812 18:00:39.366001 21757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:39.366319 21755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:39.375528 21762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:39.381114 21762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:39.382208 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:39.389482 21762 catalog_manager.cc:1347] Generated new cluster ID: 8cda20d58d57451583a629ff154cda82
I20260812 18:00:39.389756 21762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:39.402549 21762 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:39.404212 21762 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:39.415426 21762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef: Generated new TSK 0
I20260812 18:00:39.416025 21762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:39.448324 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:39.454394 21777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:39.455695 21779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:39.462783 21783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:39.463038 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:39.463989 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:39.464177 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:39.464291 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557639464283 us; error 0 us; skew 500 ppm
I20260812 18:00:39.464890 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:39.467233 17557 webserver.cc:460] Webserver started at http://127.17.37.65:35149/ using document root <none> and password file <none>
I20260812 18:00:39.467664 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:39.467813 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:39.468003 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:39.469117 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "98e48495583c455db211799c1dc29926"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.473694 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 18:00:39.476827 21788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:39.477607 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 18:00:39.477921 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "98e48495583c455db211799c1dc29926"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.478258 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:39.494796 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:39.495780 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:39.501068 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:39.501425 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:39.501784 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:39.502015 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:39.551249 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:34487
I20260812 18:00:39.551362 21877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:34487 every 8 connection(s)
I20260812 18:00:39.555553 21878 heartbeater.cc:347] Connected to a master server at 127.17.37.126:37571
I20260812 18:00:39.555929 21878 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:39.556530 21878 heartbeater.cc:511] Master 127.17.37.126:37571 requested a full tablet report, sending...
I20260812 18:00:39.558218 21712 ts_manager.cc:194] Registered new tserver with Master: 98e48495583c455db211799c1dc29926 (127.17.37.65:34487)
I20260812 18:00:39.559131 17557 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004738417s
I20260812 18:00:39.560003 21712 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34158
I20260812 18:00:39.592170 21835 tablet_service.cc:1467] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260812 18:00:39.593271 21835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:39.603726 21890 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: Bootstrap starting.
I20260812 18:00:39.608227 21890 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:39.612075 21890 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: No bootstrap required, opened a new log
I20260812 18:00:39.612438 21890 ts_tablet_manager.cc:1397] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260812 18:00:39.614342 21890 raft_consensus.cc:348] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.614737 21890 raft_consensus.cc:374] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:39.614902 21890 raft_consensus.cc:729] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e48495583c455db211799c1dc29926, State: Initialized, Role: FOLLOWER
I20260812 18:00:39.615335 21890 consensus_queue.cc:260] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.615749 21890 raft_consensus.cc:388] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:39.615923 21890 raft_consensus.cc:482] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:39.616137 21890 raft_consensus.cc:3037] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:39.620086 21890 raft_consensus.cc:504] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.620528 21890 leader_election.cc:302] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98e48495583c455db211799c1dc29926; no voters:
I20260812 18:00:39.621657 21890 leader_election.cc:288] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:39.622143 21892 raft_consensus.cc:2781] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:39.623546 21878 heartbeater.cc:503] Master 127.17.37.126:37571 was elected leader, sending a full tablet report...
I20260812 18:00:39.623603 21892 raft_consensus.cc:686] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 1 LEADER]: Becoming Leader. State: Replica: 98e48495583c455db211799c1dc29926, State: Running, Role: LEADER
I20260812 18:00:39.623965 21890 ts_tablet_manager.cc:1428] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260812 18:00:39.624467 21892 consensus_queue.cc:237] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.628700 21895 tablet_replica.cc:439] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: TxnStatusTablet state changed. Reason: New leader 98e48495583c455db211799c1dc29926. Latest consensus state: current_term: 1 leader_uuid: "98e48495583c455db211799c1dc29926" committed_config { opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } } }
I20260812 18:00:39.629444 21895 tablet_replica.cc:442] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: This TxnStatusTablet replica's current role is: LEADER
I20260812 18:00:39.628871 21893 tablet_replica.cc:439] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98e48495583c455db211799c1dc29926" committed_config { opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } } }
I20260812 18:00:39.630215 21893 tablet_replica.cc:442] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: This TxnStatusTablet replica's current role is: LEADER
W20260812 18:00:39.631073 21712 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:39.631294 21899 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 18:00:39.632200 21899 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260812 18:00:39.634634 21712 catalog_manager.cc:5328] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260812 18:00:39.654563 21835 tablet_service.cc:1467] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260812 18:00:39.655591 21835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:39.665376 21890 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: Bootstrap starting.
I20260812 18:00:39.669260 21890 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:39.673319 21890 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: No bootstrap required, opened a new log
I20260812 18:00:39.673682 21890 ts_tablet_manager.cc:1397] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 18:00:39.675309 21890 raft_consensus.cc:348] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.675673 21890 raft_consensus.cc:374] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:39.675848 21890 raft_consensus.cc:729] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e48495583c455db211799c1dc29926, State: Initialized, Role: FOLLOWER
I20260812 18:00:39.676226 21890 consensus_queue.cc:260] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.676597 21890 raft_consensus.cc:388] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:39.676786 21890 raft_consensus.cc:482] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:39.676971 21890 raft_consensus.cc:3037] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:39.681290 21890 raft_consensus.cc:504] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.681743 21890 leader_election.cc:302] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98e48495583c455db211799c1dc29926; no voters:
I20260812 18:00:39.682243 21890 leader_election.cc:288] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:39.682397 21895 raft_consensus.cc:2781] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:39.682864 21895 raft_consensus.cc:686] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 1 LEADER]: Becoming Leader. State: Replica: 98e48495583c455db211799c1dc29926, State: Running, Role: LEADER
I20260812 18:00:39.683400 21895 consensus_queue.cc:237] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "98e48495583c455db211799c1dc29926" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 34487 } }
I20260812 18:00:39.683732 21890 ts_tablet_manager.cc:1428] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
W20260812 18:00:39.688503 21712 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260812 18:00:39.692000 21712 catalog_manager.cc:5328] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260812 18:00:39.714075 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:39.732937 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:39.733634 17557 tablet_replica.cc:330] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926: stopping tablet replica
I20260812 18:00:39.734221 17557 raft_consensus.cc:2229] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:39.734629 17557 raft_consensus.cc:2258] T 22222222222222222222222222222222 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:39.736966 17557 tablet_replica.cc:330] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926: stopping tablet replica
I20260812 18:00:39.737408 17557 raft_consensus.cc:2229] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:39.737880 17557 raft_consensus.cc:2258] T 11111111111111111111111111111111 P 98e48495583c455db211799c1dc29926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:39.758562 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:39.772332 17557 master.cc:537] Master@127.17.37.126:37571 shutting down...
I20260812 18:00:39.787519 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:39.788023 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:39.788424 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 52d8fd9edc0c435ea75d803ca7dd0cef: stopping tablet replica
I20260812 18:00:39.806799 17557 master.cc:552] Master@127.17.37.126:37571 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (575 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3369 ms total)
[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/0
I20260812 18:00:39.828584 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:39703
I20260812 18:00:39.829608 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:39.834259 21911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:39.835564 21912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:39.837076 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:39.837641 21914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:39.838392 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:39.838580 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:39.838732 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557639838717 us; error 0 us; skew 500 ppm
I20260812 18:00:39.839195 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:39.841315 17557 webserver.cc:460] Webserver started at http://127.17.37.126:42043/ using document root <none> and password file <none>
I20260812 18:00:39.841909 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:39.842118 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:39.842376 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:39.843406 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.847496 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 18:00:39.850586 21920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:39.851498 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:39.851989 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e"
format_stamp: "Formatted at 2026-08-12 18:00:39 on dist-test-slave-6nmv"
I20260812 18:00:39.852523 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:39.876595 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:39.877364 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:39.910122 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:39703
I20260812 18:00:39.910208 21979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:39703 every 8 connection(s)
I20260812 18:00:39.913678 21980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:39.922873 21980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e: Bootstrap starting.
I20260812 18:00:39.927105 21980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:39.930543 21980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e: No bootstrap required, opened a new log
I20260812 18:00:39.932361 21980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER }
I20260812 18:00:39.932723 21980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:39.932910 21980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6701b2aeeafe48dcb7f9e8faa12ec94e, State: Initialized, Role: FOLLOWER
I20260812 18:00:39.933511 21980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER }
I20260812 18:00:39.934011 21980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:39.934248 21980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:39.934496 21980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:39.938160 21980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER }
I20260812 18:00:39.938591 21980 leader_election.cc:302] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6701b2aeeafe48dcb7f9e8faa12ec94e; no voters:
I20260812 18:00:39.939570 21980 leader_election.cc:288] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:39.939834 21983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:39.941263 21983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 1 LEADER]: Becoming Leader. State: Replica: 6701b2aeeafe48dcb7f9e8faa12ec94e, State: Running, Role: LEADER
I20260812 18:00:39.941977 21983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER }
I20260812 18:00:39.942438 21980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:39.944391 21985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER } }
I20260812 18:00:39.945017 21985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:39.944401 21986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6701b2aeeafe48dcb7f9e8faa12ec94e. Latest consensus state: current_term: 1 leader_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6701b2aeeafe48dcb7f9e8faa12ec94e" member_type: VOTER } }
I20260812 18:00:39.945891 21986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:39.947844 21989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:39.955160 21989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:39.958463 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:39.964191 21989 catalog_manager.cc:1347] Generated new cluster ID: 801503286cac4aa686de220ec0fba4b3
I20260812 18:00:39.964437 21989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:39.977886 21989 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:39.979317 21989 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:39.989884 21989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e: Generated new TSK 0
I20260812 18:00:39.990408 21989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:40.025975 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:40.031826 22005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:40.032991 22006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:40.035941 22008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:40.037007 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:40.037787 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:40.038076 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:40.038246 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557640038229 us; error 0 us; skew 500 ppm
I20260812 18:00:40.038770 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:40.041139 17557 webserver.cc:460] Webserver started at http://127.17.37.65:41223/ using document root <none> and password file <none>
I20260812 18:00:40.041680 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:40.041924 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:40.042224 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:40.043375 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "22ea6f6e618d4b09af2891add241f1fb"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.047740 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 18:00:40.050894 22013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.051568 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:40.051885 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "22ea6f6e618d4b09af2891add241f1fb"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.052197 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:40.063719 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:40.064651 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:40.066057 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:40.068290 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:40.068506 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.068753 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:40.068915 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.106797 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:39767
I20260812 18:00:40.106895 22087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:39767 every 8 connection(s)
I20260812 18:00:40.111269 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:40.118721 22093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:40.119593 22094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:40.122084 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:40.123798 22096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:40.124941 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:40.125197 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:40.125403 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557640125385 us; error 0 us; skew 500 ppm
I20260812 18:00:40.125608 22088 heartbeater.cc:347] Connected to a master server at 127.17.37.126:39703
I20260812 18:00:40.125982 22088 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:40.126118 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:40.126879 22088 heartbeater.cc:511] Master 127.17.37.126:39703 requested a full tablet report, sending...
I20260812 18:00:40.128901 17557 webserver.cc:460] Webserver started at http://127.17.37.66:41619/ using document root <none> and password file <none>
I20260812 18:00:40.129206 21940 ts_manager.cc:194] Registered new tserver with Master: 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767)
I20260812 18:00:40.129392 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:40.129691 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:40.130053 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:40.131268 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "1a0416fd254c4a41b413bace7a3c340e"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.131296 21940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57496
I20260812 18:00:40.136523 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 18:00:40.139793 22101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.140540 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 18:00:40.140843 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "1a0416fd254c4a41b413bace7a3c340e"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.141125 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:40.154358 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:40.155270 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:40.156528 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:40.159049 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:40.159251 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.159508 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:40.159677 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.195659 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:33053
I20260812 18:00:40.195752 22173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:33053 every 8 connection(s)
I20260812 18:00:40.200174 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:40.206687 22177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:40.207222 22178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:40.210280 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:40.211889 22180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:40.212906 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:40.213168 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:40.213392 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557640213376 us; error 0 us; skew 500 ppm
I20260812 18:00:40.214057 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:40.214133 22174 heartbeater.cc:347] Connected to a master server at 127.17.37.126:39703
I20260812 18:00:40.214599 22174 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:40.215412 22174 heartbeater.cc:511] Master 127.17.37.126:39703 requested a full tablet report, sending...
I20260812 18:00:40.216575 17557 webserver.cc:460] Webserver started at http://127.17.37.67:44613/ using document root <none> and password file <none>
I20260812 18:00:40.217047 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:40.217245 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:40.217329 21940 ts_manager.cc:194] Registered new tserver with Master: 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053)
I20260812 18:00:40.217540 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:40.218719 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-2-root/instance:
uuid: "392cef1c53df43e2b64745f97daf59d5"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.218920 21940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57500
I20260812 18:00:40.223258 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 18:00:40.226492 22189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.227196 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:40.227415 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-2-root
uuid: "392cef1c53df43e2b64745f97daf59d5"
format_stamp: "Formatted at 2026-08-12 18:00:40 on dist-test-slave-6nmv"
I20260812 18:00:40.227634 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:40.235631 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:40.236415 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:40.237531 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:40.239652 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:40.239802 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.240052 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:40.240186 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:40.276111 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.67:39225
I20260812 18:00:40.276211 22265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.67:39225 every 8 connection(s)
I20260812 18:00:40.290041 22267 heartbeater.cc:347] Connected to a master server at 127.17.37.126:39703
I20260812 18:00:40.290390 22267 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:40.291095 22267 heartbeater.cc:511] Master 127.17.37.126:39703 requested a full tablet report, sending...
I20260812 18:00:40.292846 21940 ts_manager.cc:194] Registered new tserver with Master: 392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225)
I20260812 18:00:40.293357 17557 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014554509s
I20260812 18:00:40.294428 21940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57508
I20260812 18:00:40.313117 17557 test_util.cc:268] Using random seed: 1569032456
I20260812 18:00:40.333611 21940 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57520:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 18:00:40.372424 22226 tablet_service.cc:1467] Processing CreateTablet for tablet 8b50b23d8550434f8114c1ab06a1edd9 (DEFAULT_TABLE table=test-workload [id=e72acdd2b0674a599c51e033c1303728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:40.373739 22226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b50b23d8550434f8114c1ab06a1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:40.385406 22131 tablet_service.cc:1467] Processing CreateTablet for tablet 8b50b23d8550434f8114c1ab06a1edd9 (DEFAULT_TABLE table=test-workload [id=e72acdd2b0674a599c51e033c1303728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:40.386675 22131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b50b23d8550434f8114c1ab06a1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:40.388721 22046 tablet_service.cc:1467] Processing CreateTablet for tablet 8b50b23d8550434f8114c1ab06a1edd9 (DEFAULT_TABLE table=test-workload [id=e72acdd2b0674a599c51e033c1303728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:40.389894 22046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b50b23d8550434f8114c1ab06a1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:40.393221 22288 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: Bootstrap starting.
I20260812 18:00:40.398785 22288 tablet_bootstrap.cc:654] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:40.403131 22288 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: No bootstrap required, opened a new log
I20260812 18:00:40.403546 22288 ts_tablet_manager.cc:1397] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 18:00:40.404206 22290 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Bootstrap starting.
I20260812 18:00:40.406008 22288 raft_consensus.cc:348] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.406802 22288 raft_consensus.cc:374] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:40.406697 22291 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Bootstrap starting.
I20260812 18:00:40.407192 22288 raft_consensus.cc:729] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 392cef1c53df43e2b64745f97daf59d5, State: Initialized, Role: FOLLOWER
I20260812 18:00:40.407994 22288 consensus_queue.cc:260] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.410507 22290 tablet_bootstrap.cc:654] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:40.412099 22291 tablet_bootstrap.cc:654] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:40.412986 22267 heartbeater.cc:503] Master 127.17.37.126:39703 was elected leader, sending a full tablet report...
I20260812 18:00:40.413439 22288 ts_tablet_manager.cc:1428] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20260812 18:00:40.416173 22290 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: No bootstrap required, opened a new log
I20260812 18:00:40.416843 22290 ts_tablet_manager.cc:1397] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260812 18:00:40.418998 22291 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: No bootstrap required, opened a new log
I20260812 18:00:40.419435 22291 ts_tablet_manager.cc:1397] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260812 18:00:40.419288 22290 raft_consensus.cc:348] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.420027 22290 raft_consensus.cc:374] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:40.420336 22290 raft_consensus.cc:729] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0416fd254c4a41b413bace7a3c340e, State: Initialized, Role: FOLLOWER
I20260812 18:00:40.421021 22290 consensus_queue.cc:260] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.422127 22291 raft_consensus.cc:348] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.422942 22291 raft_consensus.cc:374] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:40.423214 22291 raft_consensus.cc:729] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ea6f6e618d4b09af2891add241f1fb, State: Initialized, Role: FOLLOWER
I20260812 18:00:40.423527 22174 heartbeater.cc:503] Master 127.17.37.126:39703 was elected leader, sending a full tablet report...
I20260812 18:00:40.423823 22290 ts_tablet_manager.cc:1428] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 18:00:40.423955 22291 consensus_queue.cc:260] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.432282 22088 heartbeater.cc:503] Master 127.17.37.126:39703 was elected leader, sending a full tablet report...
I20260812 18:00:40.433317 22291 ts_tablet_manager.cc:1428] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Time spent starting tablet: real 0.014s user 0.003s sys 0.010s
I20260812 18:00:40.622238 22295 raft_consensus.cc:482] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:40.622695 22295 raft_consensus.cc:504] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.624492 22295 leader_election.cc:288] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225), 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767)
I20260812 18:00:40.636343 22236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "1a0416fd254c4a41b413bace7a3c340e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392cef1c53df43e2b64745f97daf59d5" is_pre_election: true
I20260812 18:00:40.636927 22236 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0416fd254c4a41b413bace7a3c340e in term 0.
I20260812 18:00:40.636984 22056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "1a0416fd254c4a41b413bace7a3c340e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ea6f6e618d4b09af2891add241f1fb" is_pre_election: true
I20260812 18:00:40.637643 22056 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0416fd254c4a41b413bace7a3c340e in term 0.
I20260812 18:00:40.637956 22102 leader_election.cc:302] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0416fd254c4a41b413bace7a3c340e, 392cef1c53df43e2b64745f97daf59d5; no voters:
I20260812 18:00:40.638667 22295 raft_consensus.cc:2781] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 18:00:40.638939 22295 raft_consensus.cc:482] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:40.639271 22295 raft_consensus.cc:3037] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:40.644043 22295 raft_consensus.cc:504] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.645364 22295 leader_election.cc:288] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [CANDIDATE]: Term 1 election: Requested vote from peers 392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225), 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767)
I20260812 18:00:40.646209 22056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "1a0416fd254c4a41b413bace7a3c340e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ea6f6e618d4b09af2891add241f1fb"
I20260812 18:00:40.646160 22236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "1a0416fd254c4a41b413bace7a3c340e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392cef1c53df43e2b64745f97daf59d5"
I20260812 18:00:40.646845 22056 raft_consensus.cc:3037] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:40.646936 22236 raft_consensus.cc:3037] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:40.651087 22056 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0416fd254c4a41b413bace7a3c340e in term 1.
I20260812 18:00:40.651317 22236 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0416fd254c4a41b413bace7a3c340e in term 1.
I20260812 18:00:40.652093 22103 leader_election.cc:302] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0416fd254c4a41b413bace7a3c340e, 22ea6f6e618d4b09af2891add241f1fb; no voters:
I20260812 18:00:40.652899 22295 raft_consensus.cc:2781] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:40.654026 22295 raft_consensus.cc:686] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 1 LEADER]: Becoming Leader. State: Replica: 1a0416fd254c4a41b413bace7a3c340e, State: Running, Role: LEADER
I20260812 18:00:40.654925 22295 consensus_queue.cc:237] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:40.660647 21939 catalog_manager.cc:5495] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66). New cstate: current_term: 1 leader_uuid: "1a0416fd254c4a41b413bace7a3c340e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } }
I20260812 18:00:41.007828 22131 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:41.009845 22046 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:41.010360 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:41.074549 22295 consensus_queue.cc:1035] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 18:00:41.123579 22295 consensus_queue.cc:1035] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [LEADER]: Connected to new peer: Peer: permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 1 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 0 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): RUNNING [LEADER]
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 1a0416fd254c4a41b413bace7a3c340e
C = 22ea6f6e618d4b09af2891add241f1fb
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:41.251572 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:41.604568 22131 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:41.606858 22046 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:41.608318 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 1 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 0 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260812 18:00:41.787627 17557 log_verifier.cc:126] Checking tablet 8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:41.849067 17557 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:41.849642 17557 tablet_replica.cc:330] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: stopping tablet replica
I20260812 18:00:41.850224 17557 raft_consensus.cc:2229] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:41.851120 17557 raft_consensus.cc:2258] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:42.048719 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:42.053514 22046 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:42.055265 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 0 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 1a0416fd254c4a41b413bace7a3c340e
C = 22ea6f6e618d4b09af2891add241f1fb
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:42.250134 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:42.614542 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:42.616503 22046 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:42.618700 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 0 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 1a0416fd254c4a41b413bace7a3c340e
C = 22ea6f6e618d4b09af2891add241f1fb
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:42.783939 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:43.029385 22448 raft_consensus.cc:482] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a0416fd254c4a41b413bace7a3c340e)
I20260812 18:00:43.029803 22448 raft_consensus.cc:504] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:43.043673 22448 leader_election.cc:288] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053), 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767)
I20260812 18:00:43.058849 22142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "392cef1c53df43e2b64745f97daf59d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a0416fd254c4a41b413bace7a3c340e" is_pre_election: true
I20260812 18:00:43.059991 22055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "392cef1c53df43e2b64745f97daf59d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ea6f6e618d4b09af2891add241f1fb" is_pre_election: true
W20260812 18:00:43.061586 22190 leader_election.cc:341] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): Illegal state: cannot vote while shut down
I20260812 18:00:43.062063 22190 leader_election.cc:302] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 392cef1c53df43e2b64745f97daf59d5; no voters: 1a0416fd254c4a41b413bace7a3c340e, 22ea6f6e618d4b09af2891add241f1fb
I20260812 18:00:43.062852 22448 raft_consensus.cc:2726] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 18:00:43.215166 22476 raft_consensus.cc:482] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a0416fd254c4a41b413bace7a3c340e)
I20260812 18:00:43.215729 22476 raft_consensus.cc:504] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:43.218389 22476 leader_election.cc:288] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225), 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053)
I20260812 18:00:43.218539 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:43.235438 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:43.254688 22236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "22ea6f6e618d4b09af2891add241f1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "392cef1c53df43e2b64745f97daf59d5" is_pre_election: true
I20260812 18:00:43.255378 22236 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ea6f6e618d4b09af2891add241f1fb in term 1.
I20260812 18:00:43.258595 22014 leader_election.cc:302] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ea6f6e618d4b09af2891add241f1fb, 392cef1c53df43e2b64745f97daf59d5; no voters:
I20260812 18:00:43.259622 22476 raft_consensus.cc:2781] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 18:00:43.259987 22476 raft_consensus.cc:482] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a0416fd254c4a41b413bace7a3c340e)
I20260812 18:00:43.260310 22476 raft_consensus.cc:3037] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:43.264103 22046 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:43.267635 22476 raft_consensus.cc:504] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:43.269551 22476 leader_election.cc:288] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 election: Requested vote from peers 392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225), 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053)
I20260812 18:00:43.272429 22236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "22ea6f6e618d4b09af2891add241f1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "392cef1c53df43e2b64745f97daf59d5"
I20260812 18:00:43.272986 22236 raft_consensus.cc:3037] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 18:00:43.273214 22142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "22ea6f6e618d4b09af2891add241f1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a0416fd254c4a41b413bace7a3c340e" is_pre_election: true
I20260812 18:00:43.274036 22141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b50b23d8550434f8114c1ab06a1edd9" candidate_uuid: "22ea6f6e618d4b09af2891add241f1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a0416fd254c4a41b413bace7a3c340e"
W20260812 18:00:43.274547 22014 leader_election.cc:341] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): Illegal state: cannot vote while shut down
W20260812 18:00:43.275614 22014 leader_election.cc:341] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): Illegal state: cannot vote while shut down
I20260812 18:00:43.283715 22236 raft_consensus.cc:2454] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ea6f6e618d4b09af2891add241f1fb in term 2.
I20260812 18:00:43.284823 22014 leader_election.cc:302] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ea6f6e618d4b09af2891add241f1fb, 392cef1c53df43e2b64745f97daf59d5; no voters: 1a0416fd254c4a41b413bace7a3c340e
I20260812 18:00:43.285745 22476 raft_consensus.cc:2781] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 FOLLOWER]: Leader election won for term 2
I20260812 18:00:43.296069 22476 raft_consensus.cc:686] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 LEADER]: Becoming Leader. State: Replica: 22ea6f6e618d4b09af2891add241f1fb, State: Running, Role: LEADER
I20260812 18:00:43.297051 22476 consensus_queue.cc:237] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:43.314502 21938 catalog_manager.cc:5495] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb reported cstate change: term changed from 1 to 2, leader changed from 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) to 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65). New cstate: current_term: 2 leader_uuid: "22ea6f6e618d4b09af2891add241f1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } }
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 0 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 1a0416fd254c4a41b413bace7a3c340e
C = 22ea6f6e618d4b09af2891add241f1fb
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B C | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:43.441587 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
W20260812 18:00:43.832509 22014 consensus_peers.cc:487] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb -> Peer 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): Couldn't send request to peer 1a0416fd254c4a41b413bace7a3c340e. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:43.876480 22236 raft_consensus.cc:1261] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Refusing update from remote peer 22ea6f6e618d4b09af2891add241f1fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 18:00:43.878050 22495 consensus_queue.cc:1035] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 18:00:43.993853 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:44.002813 22046 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:44.005182 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 1 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING [LEADER]
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 1a0416fd254c4a41b413bace7a3c340e
C = 22ea6f6e618d4b09af2891add241f1fb
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C* | 2 | -1 | Yes
B | [config not available] | | |
C | A B C* | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:44.203014 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:44.353262 22495 raft_consensus.cc:998] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Attempting to remove follower 1a0416fd254c4a41b413bace7a3c340e from the Raft config. Reason: The tablet replica hosted on peer 1a0416fd254c4a41b413bace7a3c340e has failed
I20260812 18:00:44.355768 22495 consensus_queue.cc:237] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } }
I20260812 18:00:44.357440 22498 raft_consensus.cc:952] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 LEADER]: Processing failure of peer 1a0416fd254c4a41b413bace7a3c340e in term 2 (The tablet replica hosted on peer 1a0416fd254c4a41b413bace7a3c340e has failed): There is already a config change operation in progress. Unable to evict follower until it completes. Doing nothing.
I20260812 18:00:44.361433 22236 raft_consensus.cc:1261] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Refusing update from remote peer 22ea6f6e618d4b09af2891add241f1fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 18:00:44.362572 22498 consensus_queue.cc:1035] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 18:00:44.367537 22495 raft_consensus.cc:2932] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } }
I20260812 18:00:44.369069 22236 raft_consensus.cc:2932] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } }
I20260812 18:00:44.378201 21937 catalog_manager.cc:5495] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb reported cstate change: config changed from index -1 to 3, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) evicted. New cstate: current_term: 2 leader_uuid: "22ea6f6e618d4b09af2891add241f1fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } }
I20260812 18:00:44.388881 22131 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b50b23d8550434f8114c1ab06a1edd9 with delete_type TABLET_DATA_TOMBSTONED (TS 1a0416fd254c4a41b413bace7a3c340e not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:55486
I20260812 18:00:44.390900 22532 ts_tablet_manager.cc:1905] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 18:00:44.392084 22055 consensus_queue.cc:237] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } }
I20260812 18:00:44.396615 22236 raft_consensus.cc:1261] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Refusing update from remote peer 22ea6f6e618d4b09af2891add241f1fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260812 18:00:44.396965 22014 consensus_peers.cc:487] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb -> Peer 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): Couldn't send request to peer 1a0416fd254c4a41b413bace7a3c340e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:44.397867 22498 consensus_queue.cc:1035] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:44.402784 22495 raft_consensus.cc:2932] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } }
I20260812 18:00:44.404256 22532 ts_tablet_manager.cc:1918] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 18:00:44.403957 22236 raft_consensus.cc:2932] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } }
I20260812 18:00:44.404623 22532 log.cc:1196] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786557580379316-17557-0/minicluster-data/ts-1-root/wals/8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:44.406673 21921 catalog_manager.cc:4841] TS 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): tablet 8b50b23d8550434f8114c1ab06a1edd9 (table test-workload [id=e72acdd2b0674a599c51e033c1303728]) successfully deleted
I20260812 18:00:44.410579 21922 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:VOTER RPC for tablet 8b50b23d8550434f8114c1ab06a1edd9 with cas_config_opid_index 3: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 18:00:44.413381 21937 catalog_manager.cc:5495] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb reported cstate change: config changed from index 3 to 4, VOTER 1a0416fd254c4a41b413bace7a3c340e (127.17.37.66) added. New cstate: current_term: 2 leader_uuid: "22ea6f6e618d4b09af2891add241f1fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } } }
I20260812 18:00:44.863543 22559 ts_tablet_manager.cc:927] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Initiating tablet copy from peer 22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767)
I20260812 18:00:44.865087 22559 tablet_copy_client.cc:316] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet copy: Beginning tablet copy session from remote peer at address 127.17.37.65:39767
I20260812 18:00:44.867452 22070 tablet_copy_service.cc:140] P 22ea6f6e618d4b09af2891add241f1fb: Received BeginTabletCopySession request for tablet 8b50b23d8550434f8114c1ab06a1edd9 from peer 1a0416fd254c4a41b413bace7a3c340e ({username='slave'} at 127.0.0.1:36990)
I20260812 18:00:44.867988 22070 tablet_copy_service.cc:161] P 22ea6f6e618d4b09af2891add241f1fb: Beginning new tablet copy session on tablet 8b50b23d8550434f8114c1ab06a1edd9 from peer 1a0416fd254c4a41b413bace7a3c340e at {username='slave'} at 127.0.0.1:36990: session id = 1a0416fd254c4a41b413bace7a3c340e-8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:44.875175 22070 tablet_copy_source_session.cc:205] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 18:00:44.877079 22559 ts_tablet_manager.cc:1905] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 18:00:44.887939 22559 ts_tablet_manager.cc:1918] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260812 18:00:44.888509 22559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b50b23d8550434f8114c1ab06a1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:44.899183 22559 tablet_copy_client.cc:791] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet copy: Starting download of 0 data blocks...
I20260812 18:00:44.899775 22559 tablet_copy_client.cc:655] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet copy: Starting download of 1 WAL segments...
I20260812 18:00:44.903990 22559 tablet_copy_client.cc:531] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 18:00:44.914091 22559 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Bootstrap starting.
I20260812 18:00:44.927166 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:44.929373 22046 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:44.934958 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:44.942028 22559 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 18:00:44.942729 22559 tablet_bootstrap.cc:492] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Bootstrap complete.
I20260812 18:00:44.943416 22559 ts_tablet_manager.cc:1397] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.003s
I20260812 18:00:44.945490 22559 raft_consensus.cc:348] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } }
I20260812 18:00:44.946162 22559 raft_consensus.cc:729] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0416fd254c4a41b413bace7a3c340e, State: Initialized, Role: FOLLOWER
I20260812 18:00:44.946873 22559 consensus_queue.cc:260] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "392cef1c53df43e2b64745f97daf59d5" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39225 } } peers { permanent_uuid: "22ea6f6e618d4b09af2891add241f1fb" member_type: VOTER last_known_addr { host: "127.17.37.65" port: 39767 } } peers { permanent_uuid: "1a0416fd254c4a41b413bace7a3c340e" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 33053 } }
I20260812 18:00:44.949198 22559 ts_tablet_manager.cc:1428] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 18:00:44.950807 22070 tablet_copy_service.cc:342] P 22ea6f6e618d4b09af2891add241f1fb: Request end of tablet copy session 1a0416fd254c4a41b413bace7a3c340e-8b50b23d8550434f8114c1ab06a1edd9 received from {username='slave'} at 127.0.0.1:36990
I20260812 18:00:44.951157 22070 tablet_copy_service.cc:433] P 22ea6f6e618d4b09af2891add241f1fb: ending tablet copy session 1a0416fd254c4a41b413bace7a3c340e-8b50b23d8550434f8114c1ab06a1edd9 on tablet 8b50b23d8550434f8114c1ab06a1edd9 with peer 1a0416fd254c4a41b413bace7a3c340e
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 1 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 8b50b23d8550434f8114c1ab06a1edd9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
392cef1c53df43e2b64745f97daf59d5 (127.17.37.67:39225): RUNNING
22ea6f6e618d4b09af2891add241f1fb (127.17.37.65:39767): RUNNING [LEADER]
1a0416fd254c4a41b413bace7a3c340e (127.17.37.66:33053): not running
State: BOOTSTRAPPING
Data state: TABLET_DATA_READY
Last status: Bootstrap starting.
All reported replicas are:
A = 392cef1c53df43e2b64745f97daf59d5
B = 22ea6f6e618d4b09af2891add241f1fb
C = 1a0416fd254c4a41b413bace7a3c340e
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 2 | 4 | Yes
B | A B* C | 2 | 4 | Yes
C | A B C | 2 | 4 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:45.113520 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:45.386870 22141 raft_consensus.cc:1203] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.3->[2.4-2.4] Dedup: 2.4->[]
I20260812 18:00:46.070391 22046 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:46.071784 22131 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:46.073549 22226 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6701b2aeeafe48dcb7f9e8faa12ec94e | 127.17.37.126:39703 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
1a0416fd254c4a41b413bace7a3c340e | 127.17.37.66:33053 | HEALTHY | <none> | 0 | 0
22ea6f6e618d4b09af2891add241f1fb | 127.17.37.65:39767 | HEALTHY | <none> | 1 | 0
392cef1c53df43e2b64745f97daf59d5 | 127.17.37.67:39225 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260812 18:00:46.246663 17557 log_verifier.cc:126] Checking tablet 8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:46.299204 17557 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 8b50b23d8550434f8114c1ab06a1edd9
I20260812 18:00:46.301926 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:46.328550 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:46.329372 17557 tablet_replica.cc:330] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb: stopping tablet replica
I20260812 18:00:46.330034 17557 raft_consensus.cc:2229] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 LEADER]: Raft consensus shutting down.
I20260812 18:00:46.330829 17557 raft_consensus.cc:2258] T 8b50b23d8550434f8114c1ab06a1edd9 P 22ea6f6e618d4b09af2891add241f1fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:46.351034 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:46.362350 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 18:00:46.383080 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:46.383682 17557 tablet_replica.cc:330] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e: stopping tablet replica
I20260812 18:00:46.384161 17557 raft_consensus.cc:2229] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:46.384539 17557 raft_consensus.cc:2258] T 8b50b23d8550434f8114c1ab06a1edd9 P 1a0416fd254c4a41b413bace7a3c340e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:46.403812 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 18:00:46.414126 17557 tablet_server.cc:178] TabletServer@127.17.37.67:0 shutting down...
I20260812 18:00:46.438005 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:46.438652 17557 tablet_replica.cc:330] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5: stopping tablet replica
I20260812 18:00:46.439194 17557 raft_consensus.cc:2229] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:46.439738 17557 raft_consensus.cc:2258] T 8b50b23d8550434f8114c1ab06a1edd9 P 392cef1c53df43e2b64745f97daf59d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:46.459645 17557 tablet_server.cc:194] TabletServer@127.17.37.67:0 shutdown complete.
I20260812 18:00:46.469415 17557 master.cc:537] Master@127.17.37.126:39703 shutting down...
I20260812 18:00:46.488632 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:46.489146 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:46.489472 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6701b2aeeafe48dcb7f9e8faa12ec94e: stopping tablet replica
I20260812 18:00:46.508246 17557 master.cc:552] Master@127.17.37.126:39703 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/0 (6708 ms)
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/1
I20260812 18:00:46.537221 17557 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.37.126:40657
I20260812 18:00:46.538270 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:46.543506 22609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.544369 22610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.545451 22612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:46.546178 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:46.546811 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:46.546972 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:46.547070 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557646547062 us; error 0 us; skew 500 ppm
I20260812 18:00:46.547480 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:46.549736 17557 webserver.cc:460] Webserver started at http://127.17.37.126:33935/ using document root <none> and password file <none>
I20260812 18:00:46.550285 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:46.550428 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:46.550625 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:46.551680 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/master-0-root/instance:
uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.555883 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 18:00:46.558851 22617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.559497 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:46.559794 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/master-0-root
uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.560051 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:46.575598 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:46.576745 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:46.618572 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.126:40657
I20260812 18:00:46.618691 22677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.126:40657 every 8 connection(s)
I20260812 18:00:46.622273 22678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:46.631795 22678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf: Bootstrap starting.
I20260812 18:00:46.636288 22678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:46.639921 22678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf: No bootstrap required, opened a new log
I20260812 18:00:46.641705 22678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER }
I20260812 18:00:46.642181 22678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:46.642395 22678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d5f8827b1ff4810b0aeb08f2fff4eaf, State: Initialized, Role: FOLLOWER
I20260812 18:00:46.643051 22678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER }
I20260812 18:00:46.643510 22678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 18:00:46.643730 22678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 18:00:46.643993 22678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:46.647826 22678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER }
I20260812 18:00:46.648273 22678 leader_election.cc:302] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d5f8827b1ff4810b0aeb08f2fff4eaf; no voters:
I20260812 18:00:46.649266 22678 leader_election.cc:288] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 18:00:46.649688 22681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:46.651062 22681 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 1 LEADER]: Becoming Leader. State: Replica: 6d5f8827b1ff4810b0aeb08f2fff4eaf, State: Running, Role: LEADER
I20260812 18:00:46.651773 22681 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER }
I20260812 18:00:46.652113 22678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 18:00:46.656844 22683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d5f8827b1ff4810b0aeb08f2fff4eaf. Latest consensus state: current_term: 1 leader_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER } }
I20260812 18:00:46.656868 22682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d5f8827b1ff4810b0aeb08f2fff4eaf" member_type: VOTER } }
I20260812 18:00:46.657907 22683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:46.657991 22682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [sys.catalog]: This master's current role is: LEADER
I20260812 18:00:46.660336 22691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 18:00:46.665087 22691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 18:00:46.668231 17557 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 18:00:46.673264 22691 catalog_manager.cc:1347] Generated new cluster ID: a0ef8f3477bb4c4eb7f0c36b59489751
I20260812 18:00:46.673523 22691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 18:00:46.709174 22691 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 18:00:46.710743 22691 catalog_manager.cc:1504] Loading token signing keys...
I20260812 18:00:46.722446 22691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf: Generated new TSK 0
I20260812 18:00:46.723057 22691 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 18:00:46.734699 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:46.740123 22703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.741294 22704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.743152 22706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:46.745378 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:46.746181 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:46.746389 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:46.746515 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557646746505 us; error 0 us; skew 500 ppm
I20260812 18:00:46.746917 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:46.748956 17557 webserver.cc:460] Webserver started at http://127.17.37.65:38533/ using document root <none> and password file <none>
I20260812 18:00:46.749325 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:46.749461 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:46.749663 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:46.750603 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-0-root/instance:
uuid: "869a46de0f4b4878ad459550649bcf12"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.754666 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 18:00:46.757333 22714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.758041 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:46.758265 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-0-root
uuid: "869a46de0f4b4878ad459550649bcf12"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.758482 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:46.774490 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:46.775633 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:46.777050 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:46.779198 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:46.779351 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.779609 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:46.779745 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.818426 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.65:33377
I20260812 18:00:46.818513 22789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.65:33377 every 8 connection(s)
I20260812 18:00:46.822824 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:46.830420 22795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.833437 22796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.835315 22798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:46.837530 22790 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40657
I20260812 18:00:46.837908 22790 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:46.838548 22790 heartbeater.cc:511] Master 127.17.37.126:40657 requested a full tablet report, sending...
I20260812 18:00:46.840647 22637 ts_manager.cc:194] Registered new tserver with Master: 869a46de0f4b4878ad459550649bcf12 (127.17.37.65:33377)
I20260812 18:00:46.841109 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:46.842170 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:46.842419 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:46.842650 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557646842619 us; error 0 us; skew 500 ppm
I20260812 18:00:46.843261 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:46.843413 22637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58444
I20260812 18:00:46.845784 17557 webserver.cc:460] Webserver started at http://127.17.37.66:39715/ using document root <none> and password file <none>
I20260812 18:00:46.846318 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:46.846496 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:46.846761 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:46.847738 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-1-root/instance:
uuid: "9f7cd3ef4c1d406599046abef5b8897a"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.851958 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 18:00:46.855232 22806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.855897 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 18:00:46.856159 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-1-root
uuid: "9f7cd3ef4c1d406599046abef5b8897a"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.856418 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:46.887841 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:46.888911 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:46.890422 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:46.892566 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:46.892810 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.893031 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:46.893179 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.930281 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.66:39409
I20260812 18:00:46.930370 22883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.66:39409 every 8 connection(s)
I20260812 18:00:46.934880 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:46.941425 22888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.942405 22890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:46.945694 22893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:46.946364 17557 server_base.cc:1034] running on GCE node
I20260812 18:00:46.947304 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:46.947563 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:46.947749 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557646947738 us; error 0 us; skew 500 ppm
I20260812 18:00:46.948269 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:46.948640 22884 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40657
I20260812 18:00:46.949064 22884 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:46.949747 22884 heartbeater.cc:511] Master 127.17.37.126:40657 requested a full tablet report, sending...
I20260812 18:00:46.950901 17557 webserver.cc:460] Webserver started at http://127.17.37.67:40503/ using document root <none> and password file <none>
I20260812 18:00:46.951365 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:46.951578 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:46.951495 22637 ts_manager.cc:194] Registered new tserver with Master: 9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409)
I20260812 18:00:46.952112 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:46.953370 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-2-root/instance:
uuid: "d13aae7a74f041f0a5c2ffc062bcc661"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.953536 22637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58456
I20260812 18:00:46.958000 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 18:00:46.961418 22902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.962239 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 18:00:46.962599 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-2-root
uuid: "d13aae7a74f041f0a5c2ffc062bcc661"
format_stamp: "Formatted at 2026-08-12 18:00:46 on dist-test-slave-6nmv"
I20260812 18:00:46.962896 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:46.973119 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:46.974244 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:46.975601 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:46.977833 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:46.978068 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:46.978282 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:46.978435 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:47.014802 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.67:39947
I20260812 18:00:47.014914 22985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.67:39947 every 8 connection(s)
I20260812 18:00:47.019125 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 18:00:47.026027 22989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 18:00:47.027026 22990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:47.030139 17557 server_base.cc:1034] running on GCE node
W20260812 18:00:47.030186 22992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 18:00:47.031320 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 18:00:47.031602 17557 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 18:00:47.031797 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786557647031781 us; error 0 us; skew 500 ppm
I20260812 18:00:47.032442 17557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 18:00:47.033452 22986 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40657
I20260812 18:00:47.033907 22986 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:47.034672 22986 heartbeater.cc:511] Master 127.17.37.126:40657 requested a full tablet report, sending...
I20260812 18:00:47.035216 17557 webserver.cc:460] Webserver started at http://127.17.37.68:43593/ using document root <none> and password file <none>
I20260812 18:00:47.035868 17557 fs_manager.cc:359] Metadata directory not provided
I20260812 18:00:47.036098 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 18:00:47.036424 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 18:00:47.036769 22637 ts_manager.cc:194] Registered new tserver with Master: d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947)
I20260812 18:00:47.037956 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root/instance:
uuid: "202474a062394371a324c5892013df5b"
format_stamp: "Formatted at 2026-08-12 18:00:47 on dist-test-slave-6nmv"
I20260812 18:00:47.038879 22637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58472
I20260812 18:00:47.042847 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 18:00:47.046077 22999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:47.046756 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 18:00:47.047022 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root
uuid: "202474a062394371a324c5892013df5b"
format_stamp: "Formatted at 2026-08-12 18:00:47 on dist-test-slave-6nmv"
I20260812 18:00:47.047268 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 18:00:47.065757 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 18:00:47.066869 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 18:00:47.068017 17557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 18:00:47.070076 17557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 18:00:47.070242 17557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:47.070482 17557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 18:00:47.070640 17557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 18:00:47.108300 17557 rpc_server.cc:307] RPC server started. Bound to: 127.17.37.68:46047
I20260812 18:00:47.108410 23076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.37.68:46047 every 8 connection(s)
I20260812 18:00:47.122522 23078 heartbeater.cc:347] Connected to a master server at 127.17.37.126:40657
I20260812 18:00:47.122956 23078 heartbeater.cc:464] Registering TS with master...
I20260812 18:00:47.123546 23078 heartbeater.cc:511] Master 127.17.37.126:40657 requested a full tablet report, sending...
I20260812 18:00:47.125180 22637 ts_manager.cc:194] Registered new tserver with Master: 202474a062394371a324c5892013df5b (127.17.37.68:46047)
I20260812 18:00:47.126380 17557 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015130878s
I20260812 18:00:47.126835 22637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58484
I20260812 18:00:47.146505 17557 test_util.cc:268] Using random seed: 1575865843
I20260812 18:00:47.169443 22637 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58500:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 18:00:47.211138 22934 tablet_service.cc:1467] Processing CreateTablet for tablet 84c98ae986144825aefe1c4407ef180f (DEFAULT_TABLE table=test-workload [id=ee7e31c0874c4a5f9e5ba49efbb4c83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:47.212347 22934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c98ae986144825aefe1c4407ef180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:47.217078 23037 tablet_service.cc:1467] Processing CreateTablet for tablet 84c98ae986144825aefe1c4407ef180f (DEFAULT_TABLE table=test-workload [id=ee7e31c0874c4a5f9e5ba49efbb4c83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:47.218282 23037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c98ae986144825aefe1c4407ef180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:47.224771 22838 tablet_service.cc:1467] Processing CreateTablet for tablet 84c98ae986144825aefe1c4407ef180f (DEFAULT_TABLE table=test-workload [id=ee7e31c0874c4a5f9e5ba49efbb4c83d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 18:00:47.225692 22838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c98ae986144825aefe1c4407ef180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:47.230453 23103 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: Bootstrap starting.
I20260812 18:00:47.234525 23104 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Bootstrap starting.
I20260812 18:00:47.236961 23103 tablet_bootstrap.cc:654] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:47.239624 23104 tablet_bootstrap.cc:654] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:47.241381 23108 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: Bootstrap starting.
I20260812 18:00:47.242295 23103 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: No bootstrap required, opened a new log
I20260812 18:00:47.242883 23103 ts_tablet_manager.cc:1397] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.001s
I20260812 18:00:47.244922 23104 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: No bootstrap required, opened a new log
I20260812 18:00:47.245353 23104 ts_tablet_manager.cc:1397] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260812 18:00:47.245584 23103 raft_consensus.cc:348] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.246336 23103 raft_consensus.cc:374] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:47.246594 23103 raft_consensus.cc:729] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13aae7a74f041f0a5c2ffc062bcc661, State: Initialized, Role: FOLLOWER
I20260812 18:00:47.246853 23108 tablet_bootstrap.cc:654] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: Neither blocks nor log segments found. Creating new log.
I20260812 18:00:47.247320 23103 consensus_queue.cc:260] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.247967 23104 raft_consensus.cc:348] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.248639 23104 raft_consensus.cc:374] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:47.248953 23104 raft_consensus.cc:729] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 202474a062394371a324c5892013df5b, State: Initialized, Role: FOLLOWER
I20260812 18:00:47.250109 22986 heartbeater.cc:503] Master 127.17.37.126:40657 was elected leader, sending a full tablet report...
I20260812 18:00:47.250483 23103 ts_tablet_manager.cc:1428] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260812 18:00:47.250835 23104 consensus_queue.cc:260] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.252827 23108 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: No bootstrap required, opened a new log
I20260812 18:00:47.253288 23108 ts_tablet_manager.cc:1397] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260812 18:00:47.253319 23078 heartbeater.cc:503] Master 127.17.37.126:40657 was elected leader, sending a full tablet report...
I20260812 18:00:47.253835 23104 ts_tablet_manager.cc:1428] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260812 18:00:47.256145 23108 raft_consensus.cc:348] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.256932 23108 raft_consensus.cc:374] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 18:00:47.257215 23108 raft_consensus.cc:729] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7cd3ef4c1d406599046abef5b8897a, State: Initialized, Role: FOLLOWER
I20260812 18:00:47.257906 23108 consensus_queue.cc:260] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.262735 22884 heartbeater.cc:503] Master 127.17.37.126:40657 was elected leader, sending a full tablet report...
I20260812 18:00:47.263147 23108 ts_tablet_manager.cc:1428] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: Time spent starting tablet: real 0.009s user 0.006s sys 0.003s
I20260812 18:00:47.312297 23112 raft_consensus.cc:482] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 18:00:47.312913 23112 raft_consensus.cc:504] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.315037 23112 leader_election.cc:288] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947), 9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409)
I20260812 18:00:47.325943 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "202474a062394371a324c5892013df5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" is_pre_election: true
I20260812 18:00:47.326717 22953 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 202474a062394371a324c5892013df5b in term 0.
I20260812 18:00:47.327787 23000 leader_election.cc:302] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 202474a062394371a324c5892013df5b, d13aae7a74f041f0a5c2ffc062bcc661; no voters:
I20260812 18:00:47.327932 22850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "202474a062394371a324c5892013df5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7cd3ef4c1d406599046abef5b8897a" is_pre_election: true
I20260812 18:00:47.328510 23112 raft_consensus.cc:2781] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 18:00:47.328581 22850 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 202474a062394371a324c5892013df5b in term 0.
I20260812 18:00:47.329022 23112 raft_consensus.cc:482] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 18:00:47.329380 23112 raft_consensus.cc:3037] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:47.334661 23112 raft_consensus.cc:504] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.336191 23112 leader_election.cc:288] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [CANDIDATE]: Term 1 election: Requested vote from peers d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947), 9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409)
I20260812 18:00:47.337302 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "202474a062394371a324c5892013df5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13aae7a74f041f0a5c2ffc062bcc661"
I20260812 18:00:47.337522 22850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "202474a062394371a324c5892013df5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7cd3ef4c1d406599046abef5b8897a"
I20260812 18:00:47.338032 22953 raft_consensus.cc:3037] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:47.338163 22850 raft_consensus.cc:3037] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 0 FOLLOWER]: Advancing to term 1
I20260812 18:00:47.345428 22953 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 202474a062394371a324c5892013df5b in term 1.
I20260812 18:00:47.345428 22850 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 202474a062394371a324c5892013df5b in term 1.
I20260812 18:00:47.346882 23000 leader_election.cc:302] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 202474a062394371a324c5892013df5b, 9f7cd3ef4c1d406599046abef5b8897a; no voters:
I20260812 18:00:47.347579 23112 raft_consensus.cc:2781] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 18:00:47.348709 23112 raft_consensus.cc:686] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 1 LEADER]: Becoming Leader. State: Replica: 202474a062394371a324c5892013df5b, State: Running, Role: LEADER
I20260812 18:00:47.349432 23112 consensus_queue.cc:237] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:47.356467 22636 catalog_manager.cc:5495] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 202474a062394371a324c5892013df5b (127.17.37.68). New cstate: current_term: 1 leader_uuid: "202474a062394371a324c5892013df5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:47.591403 23037 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:47.602026 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:47.604626 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:47.612264 22934 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:47.739652 23112 consensus_queue.cc:1035] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 18:00:47.781082 23117 consensus_queue.cc:1035] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 1 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 0 | 0
I20260812 18:00:47.846609 22790 heartbeater.cc:503] Master 127.17.37.126:40657 was elected leader, sending a full tablet report...
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 84c98ae986144825aefe1c4407ef180f of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947): RUNNING
9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409): RUNNING
202474a062394371a324c5892013df5b (127.17.37.68:46047): RUNNING [LEADER]
All reported replicas are:
A = d13aae7a74f041f0a5c2ffc062bcc661
B = 9f7cd3ef4c1d406599046abef5b8897a
C = 202474a062394371a324c5892013df5b
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C | 1 | -1 | Yes
B | A B C | 1 | -1 | Yes
C | A B C* | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:47.854650 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:48.235535 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:48.238739 23037 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:48.243382 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:48.250329 22934 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 1 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260812 18:00:48.448436 17557 log_verifier.cc:126] Checking tablet 84c98ae986144825aefe1c4407ef180f
I20260812 18:00:48.505807 17557 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 84c98ae986144825aefe1c4407ef180f
I20260812 18:00:48.507771 17557 tablet_replica.cc:330] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: stopping tablet replica
I20260812 18:00:48.508297 17557 raft_consensus.cc:2229] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:48.509130 17557 raft_consensus.cc:2258] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:48.725129 23037 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:48.728657 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:48.733433 22934 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:48.737969 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 0 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 84c98ae986144825aefe1c4407ef180f of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947): RUNNING
9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409): RUNNING
202474a062394371a324c5892013df5b (127.17.37.68:46047): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
A = d13aae7a74f041f0a5c2ffc062bcc661
B = 9f7cd3ef4c1d406599046abef5b8897a
C = 202474a062394371a324c5892013df5b
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C* | 1 | -1 | Yes
B | A B C* | 1 | -1 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:48.968396 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:49.323815 23037 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:49.333256 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:49.334537 22934 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:49.338518 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 0 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 84c98ae986144825aefe1c4407ef180f of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947): RUNNING
9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409): RUNNING
202474a062394371a324c5892013df5b (127.17.37.68:46047): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
A = d13aae7a74f041f0a5c2ffc062bcc661
B = 9f7cd3ef4c1d406599046abef5b8897a
C = 202474a062394371a324c5892013df5b
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C* | 1 | -1 | Yes
B | A B C* | 1 | -1 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:49.558928 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:49.669258 23263 raft_consensus.cc:482] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 202474a062394371a324c5892013df5b)
I20260812 18:00:49.669790 23263 raft_consensus.cc:504] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:49.671823 23263 leader_election.cc:288] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409), 202474a062394371a324c5892013df5b (127.17.37.68:46047)
I20260812 18:00:49.689370 23271 raft_consensus.cc:482] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 202474a062394371a324c5892013df5b)
I20260812 18:00:49.690738 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f7cd3ef4c1d406599046abef5b8897a" is_pre_election: true
I20260812 18:00:49.689922 23271 raft_consensus.cc:504] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:49.691613 22849 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13aae7a74f041f0a5c2ffc062bcc661 in term 1.
I20260812 18:00:49.692148 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "202474a062394371a324c5892013df5b" is_pre_election: true
I20260812 18:00:49.692821 22903 leader_election.cc:302] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7cd3ef4c1d406599046abef5b8897a, d13aae7a74f041f0a5c2ffc062bcc661; no voters:
I20260812 18:00:49.693709 23263 raft_consensus.cc:2781] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 18:00:49.692989 23271 leader_election.cc:288] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947), 202474a062394371a324c5892013df5b (127.17.37.68:46047)
I20260812 18:00:49.694103 23263 raft_consensus.cc:482] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 202474a062394371a324c5892013df5b)
I20260812 18:00:49.694525 23263 raft_consensus.cc:3037] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 1 FOLLOWER]: Advancing to term 2
W20260812 18:00:49.695263 22906 leader_election.cc:341] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 202474a062394371a324c5892013df5b (127.17.37.68:46047): Illegal state: cannot vote while shut down
I20260812 18:00:49.701691 23263 raft_consensus.cc:504] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
I20260812 18:00:49.703354 23263 leader_election.cc:288] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409), 202474a062394371a324c5892013df5b (127.17.37.68:46047)
I20260812 18:00:49.704265 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "202474a062394371a324c5892013df5b"
I20260812 18:00:49.704401 22849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f7cd3ef4c1d406599046abef5b8897a"
I20260812 18:00:49.705022 22849 raft_consensus.cc:3037] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 1 FOLLOWER]: Advancing to term 2
W20260812 18:00:49.705237 22906 leader_election.cc:341] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 202474a062394371a324c5892013df5b (127.17.37.68:46047): Illegal state: cannot vote while shut down
I20260812 18:00:49.710384 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "9f7cd3ef4c1d406599046abef5b8897a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" is_pre_election: true
I20260812 18:00:49.711124 22953 raft_consensus.cc:2379] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7cd3ef4c1d406599046abef5b8897a in current term 2: Already voted for candidate d13aae7a74f041f0a5c2ffc062bcc661 in this term.
I20260812 18:00:49.711124 22849 raft_consensus.cc:2454] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13aae7a74f041f0a5c2ffc062bcc661 in term 2.
I20260812 18:00:49.712242 22903 leader_election.cc:302] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f7cd3ef4c1d406599046abef5b8897a, d13aae7a74f041f0a5c2ffc062bcc661; no voters: 202474a062394371a324c5892013df5b
I20260812 18:00:49.713008 23263 raft_consensus.cc:2781] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 18:00:49.714144 23263 raft_consensus.cc:686] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 LEADER]: Becoming Leader. State: Replica: d13aae7a74f041f0a5c2ffc062bcc661, State: Running, Role: LEADER
I20260812 18:00:49.714434 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c98ae986144825aefe1c4407ef180f" candidate_uuid: "9f7cd3ef4c1d406599046abef5b8897a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "202474a062394371a324c5892013df5b" is_pre_election: true
I20260812 18:00:49.714944 23263 consensus_queue.cc:237] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } }
W20260812 18:00:49.715427 22810 leader_election.cc:341] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 202474a062394371a324c5892013df5b (127.17.37.68:46047): Illegal state: cannot vote while shut down
I20260812 18:00:49.715821 22810 leader_election.cc:302] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7cd3ef4c1d406599046abef5b8897a; no voters: 202474a062394371a324c5892013df5b, d13aae7a74f041f0a5c2ffc062bcc661
I20260812 18:00:49.716420 23271 raft_consensus.cc:2726] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 18:00:49.720697 22637 catalog_manager.cc:5495] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 reported cstate change: term changed from 1 to 2, leader changed from 202474a062394371a324c5892013df5b (127.17.37.68) to d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67). New cstate: current_term: 2 leader_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "202474a062394371a324c5892013df5b" member_type: VOTER last_known_addr { host: "127.17.37.68" port: 46047 } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:49.997152 23037 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:50.001704 22934 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:50.002533 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:50.013700 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 0 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 84c98ae986144825aefe1c4407ef180f of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947): RUNNING [LEADER]
9f7cd3ef4c1d406599046abef5b8897a (127.17.37.66:39409): RUNNING
202474a062394371a324c5892013df5b (127.17.37.68:46047): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
All reported replicas are:
A = d13aae7a74f041f0a5c2ffc062bcc661
B = 9f7cd3ef4c1d406599046abef5b8897a
C = 202474a062394371a324c5892013df5b
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | -1 | Yes
B | A B C | 2 | -1 | Yes
C | [config not available] | | |
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260812 18:00:50.221328 17557 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 18:00:50.267343 22849 raft_consensus.cc:1261] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Refusing update from remote peer d13aae7a74f041f0a5c2ffc062bcc661: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 18:00:50.268657 23314 consensus_queue.cc:1035] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 18:00:50.280838 22906 consensus_queue.cc:579] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: The tablet replica hosted on peer 202474a062394371a324c5892013df5b has failed
W20260812 18:00:50.281378 22906 consensus_peers.cc:487] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 -> Peer 202474a062394371a324c5892013df5b (127.17.37.68:46047): Couldn't send request to peer 202474a062394371a324c5892013df5b. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:50.290194 22953 consensus_queue.cc:237] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } }
I20260812 18:00:50.293676 22849 raft_consensus.cc:1261] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Refusing update from remote peer d13aae7a74f041f0a5c2ffc062bcc661: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 18:00:50.294821 23320 consensus_queue.cc:1035] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 18:00:50.299690 23314 raft_consensus.cc:2932] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 202474a062394371a324c5892013df5b (127.17.37.68) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } }
I20260812 18:00:50.301193 22849 raft_consensus.cc:2932] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER 202474a062394371a324c5892013df5b (127.17.37.68) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } }
I20260812 18:00:50.308739 22618 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 84c98ae986144825aefe1c4407ef180f with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 18:00:50.312227 22637 catalog_manager.cc:5495] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 reported cstate change: config changed from index -1 to 3, VOTER 202474a062394371a324c5892013df5b (127.17.37.68) evicted. New cstate: current_term: 2 leader_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } health_report { overall_health: HEALTHY } } }
I20260812 18:00:50.323458 23037 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c98ae986144825aefe1c4407ef180f with delete_type TABLET_DATA_TOMBSTONED (TS 202474a062394371a324c5892013df5b not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:47588
I20260812 18:00:50.325511 23328 ts_tablet_manager.cc:1905] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 18:00:50.327026 22953 consensus_queue.cc:237] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } }
I20260812 18:00:50.333266 22849 raft_consensus.cc:1261] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Refusing update from remote peer d13aae7a74f041f0a5c2ffc062bcc661: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 18:00:50.335023 23314 consensus_queue.cc:1035] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 18:00:50.340381 23328 ts_tablet_manager.cc:1918] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 18:00:50.340831 23328 log.cc:1196] T 84c98ae986144825aefe1c4407ef180f P 202474a062394371a324c5892013df5b: Deleting WAL directory at /tmp/dist-test-task2sm9tR/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786557580379316-17557-0/minicluster-data/ts-3-root/wals/84c98ae986144825aefe1c4407ef180f
I20260812 18:00:50.342674 22622 catalog_manager.cc:4841] TS 202474a062394371a324c5892013df5b (127.17.37.68:46047): tablet 84c98ae986144825aefe1c4407ef180f (table test-workload [id=ee7e31c0874c4a5f9e5ba49efbb4c83d]) successfully deleted
I20260812 18:00:50.342000 23323 raft_consensus.cc:2932] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, NON_VOTER 869a46de0f4b4878ad459550649bcf12 (127.17.37.65) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } } }
I20260812 18:00:50.343782 22849 raft_consensus.cc:2932] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, NON_VOTER 869a46de0f4b4878ad459550649bcf12 (127.17.37.65) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } } }
I20260812 18:00:50.350946 22618 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 84c98ae986144825aefe1c4407ef180f with cas_config_opid_index 3: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20260812 18:00:50.351086 22904 consensus_peers.cc:487] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 -> Peer 869a46de0f4b4878ad459550649bcf12 (127.17.37.65:33377): Couldn't send request to peer 869a46de0f4b4878ad459550649bcf12. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84c98ae986144825aefe1c4407ef180f. This is attempt 1: this message will repeat every 5th retry.
I20260812 18:00:50.354125 22637 catalog_manager.cc:5495] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 reported cstate change: config changed from index 3 to 4, NON_VOTER 869a46de0f4b4878ad459550649bcf12 (127.17.37.65) added. New cstate: current_term: 2 leader_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 18:00:50.768457 22748 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:50.772799 23037 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:50.790079 22838 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260812 18:00:50.791477 22934 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 18:00:50.802908 23364 ts_tablet_manager.cc:927] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Initiating tablet copy from peer d13aae7a74f041f0a5c2ffc062bcc661 (127.17.37.67:39947)
I20260812 18:00:50.844522 23364 tablet_copy_client.cc:316] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: tablet copy: Beginning tablet copy session from remote peer at address 127.17.37.67:39947
I20260812 18:00:50.871205 22967 tablet_copy_service.cc:140] P d13aae7a74f041f0a5c2ffc062bcc661: Received BeginTabletCopySession request for tablet 84c98ae986144825aefe1c4407ef180f from peer 869a46de0f4b4878ad459550649bcf12 ({username='slave'} at 127.0.0.1:59868)
I20260812 18:00:50.871830 22967 tablet_copy_service.cc:161] P d13aae7a74f041f0a5c2ffc062bcc661: Beginning new tablet copy session on tablet 84c98ae986144825aefe1c4407ef180f from peer 869a46de0f4b4878ad459550649bcf12 at {username='slave'} at 127.0.0.1:59868: session id = 869a46de0f4b4878ad459550649bcf12-84c98ae986144825aefe1c4407ef180f
I20260812 18:00:50.879964 22967 tablet_copy_source_session.cc:205] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 18:00:50.887614 23364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c98ae986144825aefe1c4407ef180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 18:00:50.921933 23364 tablet_copy_client.cc:791] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: tablet copy: Starting download of 0 data blocks...
I20260812 18:00:50.922632 23364 tablet_copy_client.cc:655] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: tablet copy: Starting download of 1 WAL segments...
I20260812 18:00:50.927182 23364 tablet_copy_client.cc:531] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 18:00:50.936609 23364 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Bootstrap starting.
I20260812 18:00:51.018994 23364 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 18:00:51.021644 23364 tablet_bootstrap.cc:492] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Bootstrap complete.
I20260812 18:00:51.023481 23364 ts_tablet_manager.cc:1397] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Time spent bootstrapping tablet: real 0.087s user 0.034s sys 0.012s
I20260812 18:00:51.030025 23364 raft_consensus.cc:348] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } }
I20260812 18:00:51.032493 23364 raft_consensus.cc:729] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 869a46de0f4b4878ad459550649bcf12, State: Initialized, Role: LEARNER
I20260812 18:00:51.033516 23364 consensus_queue.cc:260] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d13aae7a74f041f0a5c2ffc062bcc661" member_type: VOTER last_known_addr { host: "127.17.37.67" port: 39947 } } peers { permanent_uuid: "9f7cd3ef4c1d406599046abef5b8897a" member_type: VOTER last_known_addr { host: "127.17.37.66" port: 39409 } } peers { permanent_uuid: "869a46de0f4b4878ad459550649bcf12" member_type: NON_VOTER last_known_addr { host: "127.17.37.65" port: 33377 } attrs { promote: true } }
I20260812 18:00:51.037726 23364 ts_tablet_manager.cc:1428] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
I20260812 18:00:51.043069 22967 tablet_copy_service.cc:342] P d13aae7a74f041f0a5c2ffc062bcc661: Request end of tablet copy session 869a46de0f4b4878ad459550649bcf12-84c98ae986144825aefe1c4407ef180f received from {username='slave'} at 127.0.0.1:59868
I20260812 18:00:51.043776 22967 tablet_copy_service.cc:433] P d13aae7a74f041f0a5c2ffc062bcc661: ending tablet copy session 869a46de0f4b4878ad459550649bcf12-84c98ae986144825aefe1c4407ef180f on tablet 84c98ae986144825aefe1c4407ef180f with peer 869a46de0f4b4878ad459550649bcf12
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
6d5f8827b1ff4810b0aeb08f2fff4eaf | 127.17.37.126:40657 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
202474a062394371a324c5892013df5b | 127.17.37.68:46047 | HEALTHY | <none> | 0 | 0
869a46de0f4b4878ad459550649bcf12 | 127.17.37.65:33377 | HEALTHY | <none> | 0 | 0
9f7cd3ef4c1d406599046abef5b8897a | 127.17.37.66:39409 | HEALTHY | <none> | 0 | 0
d13aae7a74f041f0a5c2ffc062bcc661 | 127.17.37.67:39947 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+--------------------+---------------
Small | 202474a062394371a324c5892013df5b | 127.17.37.68:46047 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260812 18:00:51.116022 17557 log_verifier.cc:126] Checking tablet 84c98ae986144825aefe1c4407ef180f
I20260812 18:00:51.175992 17557 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 84c98ae986144825aefe1c4407ef180f
I20260812 18:00:51.180147 17557 tablet_server.cc:178] TabletServer@127.17.37.65:0 shutting down...
I20260812 18:00:51.212729 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:51.213721 17557 tablet_replica.cc:330] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12: stopping tablet replica
I20260812 18:00:51.214282 17557 raft_consensus.cc:2229] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12 [term 2 LEARNER]: Raft consensus shutting down.
I20260812 18:00:51.214650 17557 raft_consensus.cc:2258] T 84c98ae986144825aefe1c4407ef180f P 869a46de0f4b4878ad459550649bcf12 [term 2 LEARNER]: Raft consensus is shut down!
I20260812 18:00:51.235121 17557 tablet_server.cc:194] TabletServer@127.17.37.65:0 shutdown complete.
I20260812 18:00:51.246850 17557 tablet_server.cc:178] TabletServer@127.17.37.66:0 shutting down...
I20260812 18:00:51.269369 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:51.270231 17557 tablet_replica.cc:330] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a: stopping tablet replica
I20260812 18:00:51.270829 17557 raft_consensus.cc:2229] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 18:00:51.271644 17557 raft_consensus.cc:2258] T 84c98ae986144825aefe1c4407ef180f P 9f7cd3ef4c1d406599046abef5b8897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:51.292820 17557 tablet_server.cc:194] TabletServer@127.17.37.66:0 shutdown complete.
I20260812 18:00:51.303853 17557 tablet_server.cc:178] TabletServer@127.17.37.67:0 shutting down...
I20260812 18:00:51.325325 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:51.326411 17557 tablet_replica.cc:330] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661: stopping tablet replica
I20260812 18:00:51.327271 17557 raft_consensus.cc:2229] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 LEADER]: Raft consensus shutting down.
W20260812 18:00:51.328466 22904 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.37.65:33377: connect: Connection refused (error 111) [suppressed 115 similar messages]
I20260812 18:00:51.328646 17557 raft_consensus.cc:2258] T 84c98ae986144825aefe1c4407ef180f P d13aae7a74f041f0a5c2ffc062bcc661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:51.340966 17557 tablet_server.cc:194] TabletServer@127.17.37.67:0 shutdown complete.
I20260812 18:00:51.353786 17557 tablet_server.cc:178] TabletServer@127.17.37.68:0 shutting down...
I20260812 18:00:51.378947 17557 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260812 18:00:51.396543 17557 tablet_server.cc:194] TabletServer@127.17.37.68:0 shutdown complete.
I20260812 18:00:51.407742 17557 master.cc:537] Master@127.17.37.126:40657 shutting down...
I20260812 18:00:51.427867 17557 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 1 LEADER]: Raft consensus shutting down.
I20260812 18:00:51.428439 17557 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 18:00:51.428768 17557 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6d5f8827b1ff4810b0aeb08f2fff4eaf: stopping tablet replica
I20260812 18:00:51.446280 17557 master.cc:552] Master@127.17.37.126:40657 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4940 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (11648 ms total)
[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (70938 ms total)
[ PASSED ] 11 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[ FAILED ] 1 test, listed below:
[ FAILED ] TsTabletManagerITest.TestTableStats
1 FAILED TEST
I20260812 18:00:51.486660 17557 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~12 seconds ago
I20260812 18:00:51.486963 17557 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 65 messages since previous log ~62 seconds ago
I20260812 18:00:51.487296 17557 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 9 messages since previous log ~15 seconds ago